AI-deck 1.1 - Bitcraze

AI-deck is designed for researchers and developers who want to create and explore their own integrated artificial intelligence applications.

It integrates a GAP8 processor and a grayscale camera to provide the necessary hardware for on-board perception and AI processing. The platform is lightweight and low-power, making it ideal for prototyping and experiments on the Crazyflie 2.x drone by users with experience in embedded systems development.

The on-board ESP32 provides WiFi connectivity and can be programmed for custom communication or integration tasks. Features such as AI workloads and connectivity are designed to be developed by the user, making the platform highly adaptable to custom research and prototyping.

Installation Requirements.

A compatible JTAG programmer/debugger is required to configure and use this board, which is essential for flashing, debugging, and bootloader recovery.
We recommend that you read the configuration instructions carefully and make sure you have the necessary accessories and are familiar with embedded system development before purchasing.

We recommend the use of the Olimex ARM-USB-TINY-H.

AI-deck version 1.1 has only minor updates compared to AI-deck 1.0.
The Himax camera module is now in the grayscale version, and GAP8 has been updated to revision C instead of B.

If the Bayer RGB camera version is desired, this can be purchased separately.

Features

• GAP8: 8+1-core ultra-low power RISC-V IoT processor
• Himax HM01B0: ultra-low power grayscale camera, 320×320 resolution
• Memory: 512 Mbit HyperFlash and 64 Mbit HyperRAM
• ESP32 for WiFi connectivity and other functions (NINA-W102)
• JTAG: 2 x 10-pin Cortex-M for GAP8 and ESP32
• Button connected to ESP32 for UART bootloader or other actions
• Green LED connected to GAP8 (A2)
• Green LED connected to ESP32 (GPIO_24)
• Standalone operation possible, power supply via VCOM
• Can be mounted above or below the Crazyflie 2.X

How it works

Using GreenWaves Technologies' GAP8 IoT processor and a camera, theAI-deck provides the essential hardware to capture, analyze and classify its surroundings. Originally unveiled by ETH Zurich as a PULP-Shield PCB design by IIS-ETHZ, this lightweight, low-power module is ideal for research and development of embedded AI applications on the Crazyflie 2.x micro-dronetto.

The AI-deck 1.1 expands on-board computational capabilities, enabling experiments with custom artificial intelligence workloads, including the possible implementation of autonomous navigation. The ESP32 provides WiFi connectivity and can be programmed to handle custom communications.

A compatible JTAG programmer/debugger is required for initial flashing, debugging, and bootloader recovery. For detailed instructions, refer to the GAP8 bootloader section in the "getting-started" guide and flashing documentation. Familiarity with embedded systems development is recommended for effective use of the platform.

AI-deck version 1.1 has only minor updates compared to AI-deck 1.0. The Himax camera module is now in grayscale version and the GAP8 is now revision C instead of B. The Bayer RGB version of the camera can be purchased separately.

Usage

AI-deck adds WiFi connectivity to the Crazyflie, which can be used to communicate with the Crazyflie itself and the AI-deck. As for the camera and GAP8, no preset functionality is provided-these resources are left completely up to the user, who can exploit them as he or she wishes.

The AI-deck can be mounted either above or below the Crazyflie 2.x.

The ESP32 antenna of the AI-deck is rather fragile and can be damaged in case of a crash. For added strength, we recommend mounting the AI-deck at the bottom or attaching a small piece of hot glue, as shown in the picture below.

To start using the deck, follow the Getting Started Guide. Once the setup is complete, you can try out the default examples or start developing your own AI-based applications.

Development

The main purpose of the AI-deck is to enable you to develop your own AI-based applications. To get started, you need to follow the Getting started with the AI deck tutorial; then you can explore the examples provided or start developing your own application right away.

Although you can flash the GAP8 "over-the-air," you must first install the bootloader on the GAP8 using a JTAG adapter. See the GAP8 bootloader section in the Getting Started guide and flashing documentation.

Using the Crazyflie Packet eXchange (CPX) protocol, you will be able to communicate between the host computer, the ESP32, the GAP8, and the Crazyflie's STM32. This allows you to easily send data from the GAP8 to the host computer via WiFi or to the STM32 on the Crazyflie, and vice versa. The CPX protocol is also used for console printing from the ESP32 and GAP8, which will be sent to the Crazyflie and displayed in the Crazyflie client.

Workshop

Check out the workshop on the PULP platform dedicated to the AI deck! Please note that some instructions have been updated: always refer to the Getting Started guide for the latest procedures.

The package contains: 1 x AI-deck 1.1 - Bitcraze
Specifically, the kit includes:

• 1 x AI-deck 1.1
• 2 x Long pin headers (15 mm - plastic 4 mm - pin 6 mm)