Powerful computing power, enabling a new frontier of physical intelligence

The Mercury humanoid B1,X1 uses the new Nvidia Jetson Xavier edge computing core as the master module. The AI performance of up to 21TOPS enables these modules to provide powerful computing power for 2891005 processing visual ranging, sensor fusion, positioning and map construction, obstacle detection and path planning algorithms, creating infinite possibilities for development and application in the field of embodies intelligence.

Especially in the process of overcoming the technical challenges of VR teleoperation, ensuring the acquisition of low-latency video streams has been one of the key challenges. Elephantbot has adopted an innovative solution to successfully implement GPU-accelerated video codec by utilizing the Accelerated GStreamer plug-in from the NVIDIA Xavier platform to maximize bandwidth utilization while maintaining real-time performance and providing hardware acceleration for VR teleoperation.

04Seven integrated algorithms to build machine intelligence

For the first time, the Mercury robot series integrates seven intelligent algorithms to improve the kinematics and dynamics of the robot arm as a whole, suppress vibration, smooth collaboration between the two arms, and deep integration with vision, laser and voice sensors to create three-dimensional machine intelligence under the support of artificial intelligence.

Mercury seven-axis manipulator control:

The kinematics algorithm can realize the corresponding trajectories such as straight line, arc and spline. 2891005 The seven-axis robot arm, also known as the redundant robot arm, has a redundant structure similar to the human hand, which can maintain the end pose unchanged, and can realize zero-space motion only by modifying the redundant arm Angle. The existence of redundant arm angles enables the robot to move to adjacent continuous positions without large gesture rotation, which has unique advantages in small-range rotational motion. Mercury robot series also has drag teaching, robot arm soft floating, collision detection, speed fusion and other functions that have been implemented in other elephant robot product lines.

Double arm coordination:

Taking design inspiration from humans with two-handed collaborative work, myBlockly integrates two-arm synchronous collaborative algorithms to achieve two-arm collaborative work, making robots more flexible and efficient in complex and precise tasks. At the same time, it has conventional algorithms such as two-arm self-interference detection, synchronization and coordination.

SLAM Laser Navigation:

Advanced SLAM navigation technology with RTABMAP 3D and 2D is adopted. By sensing the flat environment with Lidar and using 3D cameras to build maps in real time and position them simultaneously, Mercury realizes intelligent navigation, obstacle avoidance, and efficient and accurate mobility.

Monocular vision:

With the help of advanced vision algorithms and OpencV-based 2891005 technology, the Mercury robotic arm implements several intelligent recognition functions. Multiple recognition methods such as color, shape, Aruco markers, feature points, and YOLO target detection enable the robotic arm to respond quickly and accurately to various tasks.

Whether it’s color recognition, shape positioning, or the ability to quickly capture specific markers, the Mercury robotic arm demonstrates exceptional flexibility and efficiency. In a complex and changing work environment, it can complete tasks in an intelligent way and is a useful assistant in the work scene.

Binocular vision:

The Mercury robot introduces advanced indoor 3D visual reconstruction technology, which is able to accurately capture the indoor environment through lidar and cameras. With feature extraction and depth estimation, accurate 3D maps are generated in real time, providing powerful support for intelligent navigation 2891005 and environmental understanding.

Speech recognition:

myBlockly combines a speech recognition and GPT model to convert a user’s voice commands into Blockly code. Users only need to generate complex Blockly code through simple verbal instructions, without manual input, which greatly improves the efficiency of programming.

ChatGPT Fusion:

myBlockly integrates with ChatGPT and enables AI programming through natural language interaction with ChatGPT. Users do not need to understand the programming language, just describe the function of the program, you can achieve one-click Blockly building blocks, easy to build complex programs.