Skip to content
@InftyAI

InftyAI

Exploring the ∞ possibilities of AI.
README.md

Hey, this is InftyAI 🪂

InftyAI is a non-profit organization focused on building AI infrastructures, like LLM inference, distributed cache system, AI Agent etc.. We 💙 Open Source.

All kinds of contributions are welcomed to the community, like PR, Issue, Idea, Documentation and more.

If you have made multiple contributions to the community or projects, enough to demonstrate an ongoing and long-term commitment to the community, please Open an issue against the InftyAI/community repo to join us.

We also have an official fundraising venue through OpenCollective. We'll use the fund transparently to support the development, maintenance, and adoption of our community.

Link us via Discord, Slack, Twitter as well.

Popular repositories Loading

  1. llmaz llmaz Public

    ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

    Go 247 41

  2. Awesome-LLMOps Awesome-LLMOps Public

    🎉 An awesome & curated list of best LLMOps tools.

    Python 154 28

  3. Manta Manta Public

    💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯

    Go 24 3

  4. llmlite llmlite Public

    🌵 A library helps to communicate with all kinds of LLMs consistently.

    Python 19 3

  5. scheduler-plugins scheduler-plugins Public

    Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.

    Go 11 3

  6. alphatrion alphatrion Public

    AlphaTrion is an open-source and all-in-one platform to build LLM-powered applications.

    Python 5 1

Repositories

Showing 10 of 13 repositories
View all repositories

Top languages

Loading…

Most used topics

Loading…