Home
News
You are here

Who needs humans to train AI? Meta's new AI can train other AIs without human feedback

By Iskra Petrova

Published: Oct 21, 2024, 2:26 AM

1comment

Apps

Meta is now announcing an AI model that basically teaches itself and others without human feedback.

Artificial Intelligence is everywhere nowadays and its presence is also bound to grow as we move forward. Many tech companies have welcomed AI and some have also created their own models instead of taking advantage of other companies' models.

Meta is one of the big players in the tech world, and has now announced a new AI model called "Self-Taught Evaluator". The aim of it is to autonomously evaluate and train other AI models.

Training AI is quite a costly endeavor, and it's a pretty tough race right now with all the competition. Developers use a technique called "Reinforcement Learning from Human Feedback", otherwise referred to as RLAIF, to train AI models. As you may presume, this technique needs human feedback and this can lead to a slower process. Well, Meta's on this with its new "Self-Taught Evaluator".

Meta AI. | Image Credit - Meta

Human feedback is needed to ensure the AI that's in development provides accurate and reliable answers, and also, checks for errors with processing data. However, the new model is capable of evaluating and training other models. It uses a technique called "chain of thought" that OpenAI used in the o1 models.

The "chain of thought" technique addresses complex problems by breaking them up into smaller logical steps. This makes an AI give more precise answers to scientific, coding, or math problems. Meta's new model itself is developed using this technique. This way, the AI trains on AI-generated data... sounds too sci-fi? Well, probably not for long, I reckon!

Jason Weston, one of the researchers involved with the process, stated that as AI evolves and becomes "more super-human", it will get better at checking its own work and it will even become better than the average human at checking its own work.

I am usually quite excited about new tech and am pretty positive about AI. It now seems to evolve quite fast and I'm curious to see what the future will hold for it.

View Full Bio

Izzy, a tech enthusiast and a key part of the PhoneArena team, specializes in delivering the latest mobile tech news and finding the best tech deals. Her interests extend to cybersecurity, phone design innovations, and camera capabilities. Outside her professional life, Izzy, a literature master's degree holder, enjoys reading, painting, and learning languages. She's also a personal growth advocate, believing in the power of experience and gratitude. Whether it's walking her Chihuahua or singing her heart out, Izzy embraces life with passion and curiosity.

Read the latest from Iskra Petrova