CursorAdapter vs ArrayAdapter for a ListView
Well I think you should look at ContentProviders. They are more natural to the problem that you are trying to solve. You have to implement your custom Cursor which ContentProvider returns on a query request.
Ref:
http://developer.android.com/guide/topics/providers/content-providers.html