Khris Middleton wants the Milwaukee Bucks to "own it and learn from it" after another painful defeat again highlighted their struggles without Jrue Holiday.

Going down 121-114 to the Atlanta Hawks on Monday meant the Bucks have lost four of their last five games.

Middleton's 34 points, and 27 points from Giannis Antetokounmpo, could not propel Milwaukee to victory as they conceded 38 points in the fourth quarter.

The team's ball handling in Holiday's six-game absence has often not been clever, and the sooner the starting point guard returns, the better for the Bucks.

The Bucks have a 4-9 record when Holiday has been absent from the team this season, and his latest absence has been them slide to 27-19 for fifth place in the Eastern Conference.

Sidelined by ankle soreness and COVID-19 protocols, Holiday also missed the win over the Brooklyn Nets that preceded the slide. Before that, he was showing exemplary form, averaging 23.9 points and 7.9 assists in his most recent 10 games, way above his season averages which now stand at 18.4 points and 6.7 assists.

"I've been playing with Giannis for years, so I know his spots where he wants the ball, how to get it to him, but Jrue adds another layer of that, where he's able to attack and get other guys going, including Giannis," Middleton said.

"I don't think it's on me to get Giannis going. I feel like Giannis gets himself going for the most part. Every now and then, I feel like I'm able to get him an easy one, but same thing with Jrue.

"We're just missing an extra playmaker, extra scorer, extra defender, an extra player out there."

Antetokounmpo had eight-of-20 shooting from the field in Monday's setback, and managed just six rebounds. Only once this season has he had fewer rebounds.

The Greek superstar leads the team with averages of 28.5 points, 11.2 rebounds and a field-goal percentage of 53.5 per cent, but there are nights when he cannot make a match-winning difference.

Middleton said the Hawks game "was a tough one to drop", and now the Bucks must regroup for a tussle with the 31-15 Memphis Grizzlies on Wednesday.

"We need to find a way to be smarter, be better," Middleton said. "Just gotta own it, learn from it, try to be better."

Coach Mike Budenholzer struck a similar tone, saying the reigning NBA champions have "a lot of areas where we need to be significantly better", adding: "We need more from everybody."