Psalm 25.8 makes this proclamation:  “Good and upright is the LORD.” And then the verses follow with a therefore:

• He instructs sinners in their way
• He leads the humble in what is right
• He teaches the humble his way
• All the paths of the LORD are steadfast love and faithfulness

The last one has a caveat – “for those who keep his covenant and his testimonies.”

This is akin to the caveat in Romans 8.28 “All things work together for good, for those who are called according to his purpose.”