This is starting to be a problem for my workflow as well. I'm prepping a complex but not crazy engineering model (4,200 parts, 25m polygons) for an animation, but the prep time between frames is completely negating the speed difference between my 3080 and 2990WX. And at the moment, every part is using the imported, diffuse material, not a single complex or advanced material in sight.
So far this hasn't been a huge issue since I've been working with more complex scenes (alembic deformation, lots of fuzz, etc) but it's a huge letdown that a "simple" scene like this is so taxing on the GPU in terms of setup :/