When we think of training robots, I suspect the default thought turns to the kind of machine learning that involves huge datasets and the machine rapidly sifting through that data to gain a level of expertise that allows it to do an effective job.
In reality, however, it’s likely that the kind of robots that might find their way into our homes will have a generic skill-set that will then be tailored to the needs of their owner.
A team from Washington State University believe that this customization training can take some lessons from the way we train animals. They suggest this is a useful approach as it doesn’t require any technical skills on behalf of the trainer.
“We want everyone to be able to program, but that’s probably not going to happen,” the team say. “So we needed to provide a way for everyone to train robots — without programming.”
Teaching Your Robot to Sit
The team developed an application that allowed people to train their virtual robot in much the same way that you would train a pet. The robot had even been designed to look like a virtual dog.
The study saw feedback delivered to users at varying speed to try and reflect the way we (and animals) learn at different speeds. So a slower response may be indicative of a lack of understanding, which would allow the trainer to offer more, or better, guidance.
“At the beginning, the virtual dog moves slowly. But as it receives more feedback and becomes more confident in what to do, it speeds up,” the authors say.
The more feedback that was received, the better the robot became at predicting the appropriate course of action in future. Interestingly, the algorithm developed by the team attempted to take account of the implied meanings behind a lack of feedback.
“When you’re training a dog, you may withhold a treat when it does something wrong,” they say. “So no feedback means it did something wrong. On the other hand, when professors are grading tests, they may only mark wrong answers, so no feedback means you did something right.”
The project has recently evolved from virtual training to educating a class of physical robots, and there will be attempts to improve the training process itself. It should prove an interesting project to follow.