Generative AI technology now being used for sports play-by-play commentary. Here's how it works

J.R. Stone Image
Tuesday, September 24, 2024 5:20PM
How Generative AI technology is being used for sports commentating
IBM's Generative AI technology is now being used for play-by-play sports commentating, as displayed at Dreamforce 2024.

SAN FRANCISCO (KGO) -- Companies are now experimenting with sports commentating done by artificial intelligence as one potential use of the technology in the world of sports.

ABC7 reporter J.R. Stone recently got an inside look at IBM's ping-pong with Generative AI to track your playing ability. It was on display at Dreamforce 2024 in San Francisco.

The same technology was used at Wimbledon and the US Open.

"This is the first year where we've brought in the Generative AI component where you actually have match commentary based off of all of the data that is being captured and then match summaries as well," said IBM's Nick Otto.

VIDEO: Dreamforce 2024: A look at AI's potential and possible problems

Salesforce CEO Marc Benioff unveiled an AI system called "Agent Force" while Senator Scott Wiener introduces an AI safety bill.

That data includes things like average ball and swing speed, along with forehand and backhand shots.

To put it to the test, Stone went head-to-head in ping-pong versus Otto, who ended up winning 11-7.

The AI came up with a summary that said:

"Nick's arm must have felt like a whirlwind, spinning the ball at an average speed of 8.45 mph. J.R. tried to keep up but his 30 forehand shots and 5.56 mph swing speed were no match."

UCLA Professor Ramesh Srinivasan believes we need to use caution with this type of technology to make sure that humans are still benefiting.

"This is both incredibly exciting and amazing and also concerning because what this means for actual journalists, what this means for human commentators," Srinivasan said.

MORE: Police officers are starting to use AI chatbots to write crime reports. Will they hold up in court?

Recently at the US Open,AI commentators were used for smaller matches. Otto says the AI didn't take any human commentators jobs.

"But there's not announcers for all those matches so we actually did generate and we were the only announcer for a lot of the matches," Otto said.

While the ping-pong setup only had a written review, the idea of the AI system gaining all that knowledge in real, or close to real time, could be a precurser as to what will come next.

Those from IBM say their Generative AI system is also being used to gather data for the human commentators who now have some very detailed stats in new categories that hadn't previously been tracked.

Now Streaming 24/7 Click Here