Jeﬀ Laake contributed instructions on how to setup LyX to work with Sweave on Windows XP or Vista so that others might benefit. I did not read the instructions thorougly! He expanded the work of Murat. As far as I understand, in comparison to my approach they avoid the need for unix shell, which is nice!
P.S. (2010-04-01) See also LyX Wiki