Testing and Monitoring Crews

Let’s step back from the technical talk for a moment and picture yourself as the coach of a sports team. Your team members (agents) each have a role to play—some are star players, others are specialists with specific skills. But as their coach, you know that the real magic happens when the whole team works together. To win the game (or finish a project), everyone needs to be in sync, right? But how do we make sure your team performs well? Simple—we test them and then monitor their performance to determine what’s working and what needs improvement. That’s what we’re going to do with our crews too.

How to test crews

Before sending our team onto the field for the big game, we can run practice drills to make sure they’re performing at their best. In CrewAI, testing works the same way. We run our agents through their tasks multiple times, checking their performance and spotting weaknesses. With the command crewai test, we can run tests on our entire crew. Think of it like running scrimmage matches with your team to see how they work together. By default, the test runs two iterations (just like giving your team two practice rounds), but we can adjust that if we want to run more drills. But what if you want to see how they perform under more pressure? Easy—you increase the number of iterations: