Browse categories
Explore
Fiverr Pro
English
$
USD
I will integrate an llm into your existing java spring boot or go backend
Gaurav S
About this gig
You have a Spring Boot or Go service that already has traffic, tests, and a release process, and now somebody wants AI in it. Every AI freelancer you have talked to is Python-only and wants to rewrite your backend or bolt a separate Python service onto the side with no plan for how it fails.
I am a backend engineer first. Spring Boot, Kafka, Kubernetes and Go in production for a top US investment bank and a US insurance provider - and I have shipped LLM services into those same live systems, inside their change-control and compliance process.
So I can put a model into your system without breaking the parts that already work.
WHAT I DO
Decide whether the LLM belongs in-process or as a separate service, define the failure path when the model is slow or down, add timeouts, retries and circuit breakers, and keep the whole thing testable in CI without calling a paid API on every run.
That last part is the one people skip, and it is why their AI feature cannot be tested.
Get to know Gaurav S
Gaurav S
Backend AI Systems Engineer
- FromIndia
- Member sinceFeb 2024
- Avg. response time2 hours
- Last delivery2 years
Languages
English, Hindi
Backend engineer with nearly four years of production experience building event-driven systems and shipping LLM-backed services into live products at a US investment bank and a US insurance provider.
I specialize in what most AI work skips: putting a model inside a service that already has traffic, tests and a release process it cannot break. Retrieval quality, evaluation harnesses, defined failure behavior.
Spring Boot, Go, Python, Kafka, Kubernetes, AWS, LangChain, LangGraph, RAG, vector databases, QLoRA.
Available full time.
My Portfolio
Other AI Development Services I Offer
FAQ
My backend is not Java or Go.
Message me. Python and Node I can also do - the title names Java and Go because that is the pairing almost nobody else offers.
Will you need to change my architecture?
My default is not to. I will tell you before I start if I think something must change, and why.
How do I test an LLM feature?
Mocked at the boundary for CI, plus a small eval suite run separately against the real model. Both are included from Standard up. This is the single most common thing teams get wrong.
Can you work with our compliance or security review?
Yes. I ship LLM features inside a bank’s review process - I am used to writing the document, not just the code.
Do you need production access?
No, and I would rather not have it. A dev environment is enough.
