🚀 Feature: OpenLLMetry for JAVA

[patpatpat123]

Which component is this feature for?

OpenAI Instrumentation

🔖 Feature description

Hello team,

Just saw the video: OpenLLMetry is all you need

If not anything else, I just wanted to say thank you for this talk.

It is interesting and easy to follow.

We are currently working on the observability stack using open telemetry for Java srpingboot project.
The stack is working fine, we are sending traces, logs, and metrics to the Grafana Cloud. Things are working fine.

Yet, we are interested in adding this OpenLLMetry to our stack.

May I ask if it is possible to enhance this and add OpenLLMetry capabilities for Java and Spring Boot applications?

Thyank you

🎤 Why is this feature needed ?

As of now, the Java SpringBoot stack is just open-telemetry compatible with logs, traces, and metrics. It would be great if OpenLLMetry could be added to the stack.

✌️ How do you aim to achieve this?

Unfortunately, I am not able to achieve that by myself.

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

• I checked and didn't find similar issue

Are you willing to submit PR?

None

[c30]

The demand for Java is still high, and more and more users are shifting from traditional applications to AI development

[nirga]

hey @patpatpat123! Thanks.
This is something that's been on the making. Potentially, using our Hub can bridge the gap in the meantime - as Spring Boot also emits OpenTelemetry you'll be able to see LLM spans directly in your traces.