I don't believe I had a rough idle in my car when my filter was clogged, though it would stall out while driving, which was a little worse haha.
As far as for the filter, it's back toward the firewall usually right behind the air filter on the carb.
Here's another sr5 with the fuel filter visible. Here its up at an angle, in a yellowish plastic color with two black hoses coming in and out of it by the firewall.
If you'd like I can grab some actual pictures of where mine is located on my stock SR5 sometime tomorrow.