There's always a chance of bricking your PSP when downgrading. I'm fairly sure we're not allowed to post how to do it here (it's illegal), so I'll just give you some pointers:
If you have a TA-082 motherboard, you'll need a special downgrader, or you
will brick your PSP.
This should tell you everything you need to know.