No, I don't think there is a feminine form of Moshe
It looks like Hebrew names ending in -e(h) are very rare. A quick search through Smadar Shir
Sidi's "Comple Book of Hebrew Baby Names" produced 8 names: Menashe
, Nae(h), Pele(h), Tene(h), Yafe
, Yefune, Yore(h), and Zeide ("grandpa" in Yiddish)
With three of these, the -e(h) is indeed a masculine ending, and with two of them there are feminine equivalents:
NAEH > NAAH ("beautiful, handsome")YAFE
("he makes forget" i.e. the death of a child); no Menasha, though
YEFUNE and YORE(H) are verbal forms ("he faces" / "he teaches"), and strictly speaking, the feminine equivalents should be TEFUNE and TORE
(of course these aren't names).
PELE(H) means "miracle"
The meaning of MOSHE
is debated. It's usually assumed that the name is of Egyptian origin ("born of ..." some deity). So in this case it may be hard to apply a standard way of feminization.
Of course ways to feminize names do not necessarily care about grammar rules.