We demonstrated all-optical switching using a hybrid nano-cavity with a single InP/InAsP nanowire and Si photonic crystal. The Q factor is ~25,000 in 1.3 um and the switching energy is a few hundred fJ. This is smaller than the energy of Si photonic crystal switches.