Anyscale Inc. has launched a new service called Anyscale Endpoints that will help developers integrate fast, cost-effective and scalable large language models into their applications. The service was announced at the 2023 Ray Summit, the project’s annual user conference, which is targeting generative artificial intelligence developers. Anyscale’s open-source Python framework Ray is software that’s used to run distributed computing projects powered by multiple cloud servers. With the launch of Anyscale Endpoints, developers now have a simple way to build distributed applications that leverage the most advanced generative AI capabilities using the application programming interfaces of popular LLMs such as OpenAI LP’s GPT-4.
