.
when passion fruits are ripe they just drop from the vine. a stressed vine will drop unripened fruits. the most likely stress factor is insufficiant or irregular watering.
for two years now i blamed the birds. a short google search would have spared me the view of a netted passion fruit vine on the fence.
