Who would you refuse to help?

When confronted by an arrogant religious man, Jesus challenged him by declaring that he needed to care for those around them. In hopes of not being required to do more than he was doing, the arrogant man tried to limit the scope of who he was responsible to help. In what ways do we limit our care? Luke 10.