Conservative upper limits on WIMP annihilation cross section from Fermi-LAT γ rays