well it really depends on what kind of money you want to spend... There are voice recorders you could buy in Walmart for around $50 but you could go to Best Buy or some electronic store and find one of better quality for a little more money,
As for video recording, I use a digital camera since it's not that obvious that I'm recording...