Yes
Just after you set your wireless up, set it like a normal network. We have a similar setup here, 2 desktops and 1 laptop on wireless, and a desktop on cable, all connecting and accessing through the router.
Cloudy
PS: If you get a 802.11g router, its backwards compatible with 802.11b.