I don't even know what you mean by investment banker as that is such a loaded term.

The two fields are very unrelated. One doesn't go through years of college, many years professional experience, and THEN pass 7 rigorous exams to become an actuary and then move into investment banking.