LinkedIn on AI-Powered Premium Experience

The AI-Powered LinkedIn Premium experience required significant investments in prompt engineering and evaluation frameworks.

Their GAI related development is powered by their new internal tools, knowledge, components, and a framework that they built for these efforts leveraging OpenAI models. They have an orchestration layer that brings results together from the entire LinkedIn ecosystem.

They seek to provide personalized takeaways and insights within five seconds which required fine-tuning the balance between penalization and response speed. They leveraged streaming responses, offline data processing, and pre-computation to reduce real-time response latency.

They built tools to evaluate the quality of responses, hallucination rates, tone, and trust.