This page lists open-source frameworks and platforms grouped by what they do. It opens with AI infrastructure, where Exo turns everyday devices into a home cluster, nanoGPT and nanochat offer small training codebases, and LLaMA-Factory handles fine-tuning. Jan-Nano appears as a small model tuned to work with MCP servers. Later sections cover conversational AI with Storm, data platforms with Hash.ai, education with DeepTutor, and computer vision with Deep-Live-Cam plus a pose estimation pointer. Shorter lists cover machine learning libraries like FlashMLA, Google's edge gallery, and FinGPT for finance. The grouping is the point. Skim the headings for the layer you need, then read the per-tool notes on capabilities, limits, and where to find the source.
AI Infrastructure
- Exo: Lets you run your own AI cluster at home using everyday devices - GitHub #AI-cluster #infrastructure
- YEScale: Provides infrastructure for enterprise large language models (LLMs), helping deploy and manage AI models efficiently
- Professional LLM infrastructure for enterprises
- Supports deploying and managing large language models
- Website: https://yescale.io/ #LLM #infrastructure #enterprise
- nanoGPT: The simplest, fastest repository for training/fine-tuning medium-sized GPT models - GitHub #GPT #training
- nanochat: The best ChatGPT that $100 can buy - GitHub #LLM #chatbot
- LLaMA-Factory: Unified platform for efficiently fine-tuning 100+ large language models (LLMs) and vision-language models (VLMs)
- Supports multiple fine-tuning methods: LoRA, QLoRA, full fine-tuning
- Integrates with popular frameworks such as PEFT and TRL
- Supports RLHF (Reinforcement Learning from Human Feedback)
- Web UI and CLI for managing the training process
- Detailed documentation and an active support community
- GitHub #fine-tuning #LLM #training #LoRA
- Documentation
- Jan-Nano: A 4-billion-parameter language model designed for deep research tasks, optimized for integration with Model Context Protocol (MCP) servers
- Size: 4B parameters
- Base model: Qwen/Qwen3-4B-Base
- Characteristics: Non-thinking model, optimized for deep research tasks
- MCP integration: Optimized to work with MCP servers, enabling effective integration with research tools and data sources
- Evaluation: Evaluated on the SimpleQA benchmark using an MCP-based benchmarking method
- Running locally: Supports vLLM with recommended sampling parameters (Temperature: 0.7, Top-p: 0.8, Top-k: 20, Min-p: 0)
- Support: The Jan app (an open-source ChatGPT alternative) runs entirely on a personal computer
- HuggingFace | GitHub #LLM #research #MCP #4B #agentic
- AdalFlow: Open-source platform for building and deploying AI applications easily and efficiently - GitHub #AI-workflow #platform
- lance-format/lance: Open-source data format designed for high performance in machine learning and data analytics applications - GitHub #data-format #ML
- Deploying-AI-IoT-Applications: Documentation and guides for deploying AI and IoT applications - GitHub #AI #IoT #deployment
- Deer Flow: Community-driven deep research framework that combines large language models (LLMs) with specialized tools such as web search, crawling, and Python execution. The goal is an efficient, automated research workflow - GitHub #research #LLM #workflow #ByteDance
- DeerFlow: Personal research assistant offering tools such as web search, a web crawler, Python services, and MCP to deliver instant information, comprehensive reports, and engaging podcasts - Website #research-assistant #MCP #tools
Conversational AI
- Storm: Open-source platform for developing and deploying intelligent conversational applications, supporting multiple languages and integrating with various AI services - GitHub #conversationalAI #chatbot
AI Infrastructure & Data Platforms
- Hash.ai: Platform that integrates data, improves decisions, and optimizes processes with AI
- Governance-first approach, suited to safety-critical and high-reliability AI applications
- Open source, used by businesses with billions of dollars in annual revenue
- Key features:
- HASH Web: Create a HASH "web" that integrates information from many sources (apps, files, email, physical sensors, databases, the web), automatically updating, cleaning, and structuring data, with a self-maintaining knowledge graph
- Process optimization and automation: Map processes, improve decisions, and use AI agents to automate
- Knowledge Graph for AI: Gives AI full context while ensuring secure, controlled data access
- Technical characteristics: Enterprise-grade security, fine-grained permissions, open source, multi-user support, unlimited history, provenance guarantees, two-way sync, real-time data
- Use cases: Demand forecasting, forecasting and preventing stock-outs, safety-critical AI applications, data integration from multiple sources, business process optimization
- Website: https://hash.ai/ #AI-platform #data-integration #knowledge-graph #governance
Education AI
- DeepTutor: AI-powered personalized learning assistant that delivers a customized learning experience for users
Computer Vision
- Deep-Live-Cam: Live camera application that uses deep learning to improve image quality and provide advanced features - GitHub #computerVision #deepLearning #liveCamera
- Pose Estimation: The problem of estimating pose in computer vision, identifying the positions of joints and body parts. Two popular solutions: YOLO-Pose (Ultralytics) and MediaPipe Pose (Google) #poseEstimation #computerVision
Machine Learning Libraries
- FlashMLA: Lightweight machine learning library designed for fast, efficient deployment of ML models in real-world applications - GitHub #ML #library #lightweight
AI Edge Computing
- Google AI Edge Gallery: Collection of AI models and applications optimized for edge devices, helping deploy AI on resource-constrained hardware - GitHub #AI #edge #gallery
Finance AI
- FinGPT: Open-source GPT platform for finance, providing large language models (LLMs) specialized for the financial domain - GitHub #finance #LLM #GPT #open-source
See also: Agent Infrastructure And Platforms · Multi Agent Systems · Agents Overview