This article discusses the use of pre-trained models with self-supervised language modeling in information retrieval and natural language processing. It highlights the benefits of using pre-trained models in downstream tasks and the potential for integrating advanced technology in these areas. The Special Issue aims to collect contributions on the integration and improvement of IR and NLP through theories, models, and applications.
