Microsoft scientists are controlling robots and aerial drones with OpenAI's ChatGPT chatbot. The researchers used ChatGPT to simplify the process of programming software commands to guide robots, because the AI model was trained on massive datasets of human text. They initially outlined in a text prompt the various commands the model could use to control a given robot, which ChatGPT used to write the computer code for the robot. They programmed ChatGPT to fly a drone and have it perform actions, as well as to control a robot arm to assemble the Microsoft logo from wooden blocks.
Although the research shows ChatGPT’s potential in robotics, the approach still has a key limitation: the chatbot can only write the computer code for the robot, based on the initial prompt or text-based request the human gives it. Hence, a human engineer must thoroughly explain to ChatGPT how the application programming interface for a robot works, otherwise the AI program will struggle to generate applicable computer code. Still, the other limitation is how it appears the robot needs to be constantly connected to ChatGPT.
More information:
https://www.pcmag.com/news/microsoft-researchers-are-using-chatgpt-to-control-robots-drones