I would try out of a sport fishing landing first. Here are a few.

http://reelsteelsportfishing.com/prices.html
http://fullthrottlesportfishing.com/
http://northwindcharters.net/

I believe they all include bait, tackle, etc, but double check just in case. Also, I would try the rock cod fishing trip first, as there the easiest and you have a 99.999% chance of catching something, so its a great intro to ocean fishing. Then you could try salmon, tuna, halibut, etc.

Hope this helps!!

P.S. If you can not fish the boats, then there are many piers and breakwaters you can fishing along the coast, including in Humboldt bay and Eureka.