Apple TV struggles with streaming

What's your wifi like there? Either on the Apple TV or on a phone in the same area check your speed with Fast.com or Speedtest.net I had a traditional router upstairs where the signal was fine, about 60 Mbps on a 75 Mbps connection, but downstairs where my TV was I only got around 10 Mbps which lead to buffering. I switched to a mesh network and now I get 60-70 Mbps now and rarely have streaming problems now.

I use 5 Apple TVs around my house and they all work great

If you the 4K one then it's gotta be internet. I have three I use in my house, one the older one, that we stream DTVNow, Netflix, and anything else on almost constantly and rarely have issues.