I suppose Japh, Jaf, Jafe, Jay, Jeff, etc. are the logical short forms.
However, sometimes people got listed in census records by nicknames. And I have seen a great many census records where people, especially men, were listed just by initials. So I would look for men who are listed as just "J." with the same surname first.