This site has some remedies
http://www.mothernature.com/Library/Bookshelf/Books/48/211.cfm
For example
quote:
Try some oil of cloves. Eugenol (oil of cloves) is available over the counter and provides exceptional temporary relief, especially for toothaches that are temperature-sensitive. Such pain is usually due to problems of the pulp, the tooth center, says Martin Trope, D.M.D., chairman of the Department of Endodontology at Temple University School of Dentistry in Philadelphia. Most drugstores sell eugenol toothache kits. You can even mix liquid eugenol with zinc oxide to create your own temporary fillings for painful cavities. A few drops on the tooth surface or in a cavity or crack should do the job until you can get to the dentist.