The ADV7513 is a HDMI transmitter. The only output clock is the TMDS clock on the HDMI output. Using different addresses should not cause jitter problems. Nor different polistry on the power down pin. The only difference could be in the power supply or grounding issues.
Why are you using different power down polarity for two of the same chips on the same board?