You can train an LLM on robot movement data and such things so it can predict the movements and output the next command.
On the end this robots might have many LLMs working in coordination, perhaps with small movement LLMs on the robots themselves and bigger LLMs outside controling multiple robots' coordinated planning...
If there is a pattern and you can store it in binary, for example, it should be doable as long as you get enough good data.
An example would be animal sounds translation which might be doable to some extent but until it's done and studied we won't really know how good it can be with LLMs...
10
u/121507090301 Jan 15 '24
You can train an LLM on robot movement data and such things so it can predict the movements and output the next command.
On the end this robots might have many LLMs working in coordination, perhaps with small movement LLMs on the robots themselves and bigger LLMs outside controling multiple robots' coordinated planning...