We need immediate help for this project- time is of the essence
Project Consulting Description:
We are an AI development/software company seeking an experienced Embedded Systems Developer with extensive experience in DIY projects, embedded systems programming, hardware implementation, and prototyping. The ideal candidate will assist us in developing a series of inexpensive embedded system prototypes using platforms such as Arduino, ESP32, Raspberry Pi, etc. for prototype and ongoing development.
Project Overview:
We aim to develop several devices with similar core functionalities but different enhancements to accomplish different tasks:
Device 1: A simple TTS/STT (Text-to-Speech/Speech-to-Text) audio capture and playback device that communicates with AI APIs, rendering answers back via real-time voice or text.
Device 2: Incorporates a small TFT or similar touch display to render AI responses as text, images, and potentially video.
Device 3: Features a camera for audio and video capture and OCR recognition via AI APIs, including facial recognition to identify individual users by their first name and other image related AI responses.
Device 4: Capable of high-quality PCM streaming audio playback with a display, integrating services like Spotify and Amazon Music for high-quality music playback.
All devices should share the same basic functionality, with enhancements added modularly for simplicity and cost-effectiveness. We require expertise to identify the most compatible and cost-effective hardware platforms that can support all these functionalities. In an ideal world, we have one specified board that is cost effective (inexpensive) reliable that we can simply enable or disable functions as needed so we are developing (if possible) one board. Our desire is to find inexpensive hardware in China that can accomplish this via AliExpress/Alibaba etc. such that we do not have to develop our own custom embedded device (until we reach scale and can do so).
Responsibilities:
Hardware Solution Identification, design and sourcing:
- Recommend cost-effective and compatible embedded platforms suitable for all device versions.
- Provide design recommendations for hardware components, including displays, cameras, audio modules, and additional peripherals.
Hardware Sourcing and Prototyping:
- Assist in sourcing all hardware components, ensuring affordability and availability compatibility and functionality.
- Develop prototypes for each device version within a short development timeline.
Programming and Integration:
- Program embedded systems to handle TTS and STT functionalities, real-time audio capture, transmission, and playback depending upon which method each board/version is using to send audio files or use real time api of AI to accomplish.
- Integrate AI APIs for communication, including real-time voice interaction and data exchange.
- Develop user interfaces for devices with displays, enabling touch interaction and rendering of AI responses in text, images, or video.
Advanced Features Implementation:
- Incorporate camera modules for audio/video capture and OCR capabilities, including facial recognition to personalize user interactions.
- Enable high-quality PCM audio streaming and playback, integrating with services like Spotify and Amazon Music.
coordinate movements via servo motors for basic device if applicable (i.e. coordinate servo motor with audio playback to move the mouth of the device. We are happy to use like spark fun servo trigger for prototype implementation for speed of use, and follow up programming after initial prototypes developed.
Documentation and Support:
- Provide thorough documentation of hardware configurations, software code, and development processes.
- Offer guidance on hardware prototyping and manufacturing for small-scale production.
Collaboration:
- Work closely with our AI development and database design team to ensure seamless integration between hardware and AI functionalities.
- Advise on best practices and optimizations for embedded systems within our resource constraints.
Qualifications:
Embedded Systems Expertise:
- Extensive experience with embedded prototyping boards such as Arduino, ESP32, Raspberry Pi, etc.
- Proven track record in DIY projects and embedded systems programming.
Hardware Development Skills:
- Proficient in hardware implementation, sourcing, and design recommendations.
- Experience in hardware prototyping and knowledge of manufacturing processes for small-scale production.
Programming Proficiency:
- Strong skills in programming languages relevant to embedded systems (e.g., C/C++, Python).
- Experience integrating TTS/STT and real-time audio APIs.
Audio and Video Integration:
- Knowledge of audio capture, processing, and playback on embedded devices.
- Experience with display technologies and camera modules, including touch interfaces and video rendering.