My graphics card:
NVida Geforce 9300M GS 256MB
H.264 decoder in DVBViewer:
CoreAVC 2.5 (it utilises GPU by using CUDA)
Ah - so it's not using DXVA (I.e. utilising the GPU and drivers for H264 decoding and acceleration using nVidia's algorithms) and instead is using CUDA (I.e. utilising the GPU as a computation tool and using CoreAVC's algorithms for H264 decoding)
I bought CoreAVC a while back - when I didn't have a proper DXVA graphics card that would support 1080i H264 decoding - and whilst impressed with its speed, wasn't hugely impressed with its quality (and when I tried it with CUDA after upgrading it seemed a bit worse)
That suggests that CoreAVC has an issue with the encoding being used. It took them quite a while to get MBAFF support into their product - as it didn't work with BBC HD in the early days (2006 ISTR) as the BBC (and then ZDF/ARD/Arte HD) were the first to use MBAFF extensions (which improve encoder efficiency) and at one point they charged extra for MBAFF support...
(Elgato's EyeTV (on the Mac) apparently uses the CoreAVC codebase - though presumably without access to CUDA-style acceleration.)
I've been using DXVA acceleration for a while now - with nVidia (9400 IGP - OK de-interlacing), ATI (4550 GPU - took ages for ATI/MS to fix when the Beeb changed encoders but decent de-interlacing once VA enabled) and Intel (i3-540 on-die IGP - rubbish at 23.976Hz - OK de-interlacing)
I suspect hardware decoders in set-top boxes and the like are more likely to be OK - as they go through more rigorous testing to ensure that they are fully H264 compliant for the profiles they are marketed to support. (Can you imagine the furore if a compliant stream didn't decode on a TV or set-top box?)