Changing pixels of a diffuse map's WritableImage has no effect.
 
In the attached test case an AnimationTimer changes per frame a single pixel within the WritableImage without any effect in the rendered diffuse map.

But as soon as the WritableImage is also added to the scene the diffuse map will be updated as well.