Where was that piece you took out, on top of the float thank? If so you took out the wrong part. The one on the top is the float adjustment. The filter is right at the end of the fuel line. If that is the part you took out, then someone has removed the filter and didn't replace it. The filter is brass in color, about 5/8 of an inch long and cylindrical in shape and hollow. You can get them at Autozone. It could be causing problems due to dirt getting into the carb and clogging it up.
However, my Holley dealer recommends just putting a filter in line. Most likely you have a 4180 carb and if it is old, you are probably experiencing problems caused by worn parts. The diaprhams get hard and don't meter fuel properly. Also, the develop vacuum leaks around the throttle plate pivots. Rebuilding it will help some, but rebuilding doesn't address the vacuum leak problems. I wouldn't waste my money on a rebuild. The 4180 is never the same and bnecomes a real problem to get running 1/2 way decent once it starts to wear.
I would recommend that you replace the carb. A remanufactured 4180 is very expensive, some where in the range of 600 bucks. You can get the same carb, minus the fuel evaporation ports that are on the float tanks, like I did (4160) for under 300 bucks. If you want to keep the evaporitive emissions ports the float tanks are directly interchangable, just clean it up real good inside and use the new floats and valves, you will have to do a float adjustment proceedure if you do this.
Also, if you want a pretty much plug and play type carb, don't get a Holley. Holleys are for people who want a real tunable carb and it is a great carb for that. If you don't want to learn carboration and how to tune one, get a Edelbroc which is a lot easier to deal with and is pretty much a drop-in-and-go carb. It takes an adapter for the throttle linkage and kickdown.
Hope I didn't bore you with information you may not have needed or wanted.
Good luck,
>-