What is the meaning of this poem?

It sounds like to me that the area they live in is dying due to lack of rain or overall poverty. The speaker of this poem also hints of a dying person - possibly the owner of The Old Stone House).The speaker is being kind in letting the person (friendless face) die there and then he the Speaker can leave.