LangSmith Agent Engineering Platform From Pioneers to Undisputed Market Leaders
Use Cases and Deployment Scope
I was a user of LangChain from pioneer years, but LangSmith Agent Engineering Platform has being the game-changing addition into the picture. With LangSmith Agent Engineering Platform I just add one line into the codebase and then prompt management and API tracing happens. In my organization Prompt management and API tracing has been constructively the faster go-to-market solution, as we change the prompts from Prompt Hub and API tracing when we want to debug or change LLMs helps on our template codebase to deploy faster for client displays.
Pros
- Prompt Hub usage when we only need to change prompts on deployed solutions. This is best on faster debugging cutting time by 50%.
- API tracing dashboard provides instant telemetry of the API segment results and other metrics which helps us to strategize multiple approaches to cost-saving, time complexities, etc.
- The Agent Builder which delivers all wiring and agents with only NLP descriptions. No custom adapters, no prompt management, no tools development.
Cons
- UI/Dashboards used to change quite frequently, which leads into learning curves every week.
- MCP servers were not visible when I used to reach the end of Agent Builders.
Return on Investment
- The debugging time in terms of production failures for any AI Systems has been reduced approximately by 60%.
- Agent Builder constructs full AI systems which are relatively simple and basic (Email triage/consolidator) in almost no time, quantitively reducing the development time by 80%
Usability
Alternatives Considered
Langfuse
Other Software Used
Ollama, Langfuse