You can try out with XAMPP
http://www.apachefriends.org/en/xampp.html
I have been using it from many days. It is a bundle software and its contains Apache, MySQL, PHP + PEAR, Perl, mod_php, mod_perl, mod_ssl, OpenSSL, phpMyAdmin, Webalizer, Mercury Mail Transport System for Win32 and NetWare Systems v3.32, JpGraph, FileZilla FTP Server and many more.
It is easy to install. Just click on installer.
Download the latest version. Latest version contain PHP5 and MySQL5
And finally it is free!!!