HUSKYLENS 2

HUSKYLENS 2 Grades: 9+ Number of Students: 1-3 Additional Resources: Wiki Page, GitHub / Technical Community Highlights: HUSKYLENS 2 is a next-generation AI vision sensor designed to put powerful machine vision into the hands of every creator. It operates on a 1.6GHz dual-core processor with an integrated 6 TOPS AI accelerator, running all algorithms directly on-device for high-speed, low-latency results. Its core design centers on three key strengths: Rich AI Model Support, featuring 20+ built-in, ready-to-use algorithms, along with the flexibility to deploy custom-trained models; Flexible LLM Interaction, capable of both calling large models and providing local, real-world perception to LLMs via its built-in MCP service; and Broad Compatibility, ensuring seamless connection with a wide range of main controllers.  Equipped with a replaceable 2MP camera, a vibrant 2.4-inch IPS touchscreen, microphone, speaker, and indicator lights, HUSKYLENS 2 is the definitive tool for educational robotics, interactive systems, and intelligent device prototyping.   Blazing-Fast On-Device AI with 6 TOPS of Power At the core of HUSKYLENS 2 lies a dual-core 1.6GHz processor with an integrated 6 TOPS AI acceleration unit. This substantial computing power, combined with 1GB of RAM, enables HUSKYLENS 2 to run complex algorithms and neural networks directly on-device. This facilitates real-time processing for demanding tasks like multi-object detection and intricate pose estimation, ensuring high-speed, low-latency performance without reliance on cloud computation.   Start Creating Instantly with Over 20 Built-in AI Models HUSKYLENS 2 is designed for immediate productivity. It comes pre-loaded with a diverse library of more than 20 AI models, covering a wide array of common computer vision tasks from face recognition to object tracking. This extensive collection allows users to start building projects right out of the box with minimal setup, significantly lowering the barrier to entry for AI application development.   Empowering LLMs with Contextual Awareness via MCP Service HUSKYLENS 2 is the first AI vision sensor to feature a built-in MCP service, fundamentally changing how LLM perceives the physical world. While other camera provide raw image "snapshots," HUSKYLENS 2 delivers a structured, intelligent brief. It can inform a Large Language Model (LLM) that it sees a specific, pre-identified person performing a particular action. This endows LLMs with accurate, context-aware perception, enabling them to make smarter, more informed decisions.   Deployment of Custom Models Trained with YOLO Beyond the built-in models, users can train their own vision models using YOLO and deploy them on HUSKYLENS 2. HUSKYLENS 2 comes with a complete set of annotation, training, and conversion tools, making it easy to create custom-trained models.   Flexible Model Combination for Diverse Applications HUSKYLENS 2 architecture supports the serial or parallel execution of multiple models. This capability enables the creation of more complex and nuanced applications. For instance, combining hand keypoint detection with object tracking can create sophisticated contactless control systems, where a gesture can initiate the tracking of a specific object. This multi-model approach allows for layered logic and more intelligent interactive behaviors.   Real-time Video Streaming for Monitoring and Debugging HUSKYLENS 2 facilitates seamless data collection and image display through its real-time video streaming function. It supports both wired (USB-C) and wireless (via an optional Wi-Fi module) image transmission. This is critical for applications requiring remote monitoring, for collecting datasets to train new models, and for debugging visual applications by providing a live view of what the sensor sees.   Replaceable Camera Module for Any Application HUSKYLENS 2 is equipped with a modular camera module, allowing it to easily adapt to a wide range of scenarios—from microscopic inspection to long-range monitoring. Its unmatched flexibility supports interchangeable lenses, including manual focus, microscope, and night vision modules.   Broad Compatibility with Mainstream Controllers With standard UART and I2C interfaces, HUSKYLENS 2 ensures seamless connectivity with a wide range of microcontrollers and single-board computers, including Arduino, micro:bit, Raspberry Pi, and ESP32.   Model Hub for Ready-to-Use Vertical Models (Coming Soon) To further accelerate development, a Model Hub will be launched. This online platform will host a curated collection of official and user-generated models tailored for specific vertical markets, such as agriculture, retail, and safety monitoring. Users will be able to browse, download, and deploy these specialized models directly to their HUSKYLENS 2, providing instant access to powerful, niche AI capabilities. Technology Requirements/Specifications: CPU Kendryte K230 dual-core, 1.6 GHz Compute Power 6 TOPS Memory 1 GB LPDDR4 Storage 8 GB eMMC Display 2.4" IPS screen 640 × 480 resolution Full-lamination capacitive touchscreen Camera GC2093 sensor, 2 MP 1/2.9” format, 60 FPS Audio MEMS microphones 1 W speaker Additional Components Button × 1 RGB light × 1 Fill light × 2 Interfaces Type-C × 1 4-Pin Gravity × 1 TF card slot × 2 Physical Characteristics Dimensions: 70 × 58 × 19 mm Weight: 90 g (without packaging) Power Operating voltage: 3.3 – 5 V Power consumption: 1.5 – 3 W Connectivity 2.4 GHz Wi-Fi 6 (card-based module) Built-in AI Models Face Detection / Recognition / Feature Detection Object Recognition / Tracking / Classification / Self-Learning Classification Instance Segmentation Hand Detection / Keypoint Detection / Gesture Recognition Human Detection / Keypoint Detection / Pose Recognition License Plate Recognition Text & Line Tracking Expression & Gaze Detection Face Orientation Detection QR Code, Barcode, and Tag Recognition Color Recognition Fall Detection Built-in Applications Camera Video Recorder Real-Time Video Transmission MCP Service Model Deployment