Folder indexing returns incomplete list of files

[daeh]

I have several folder uploaded to OSF with >100 files in them. I'm indexing the contents using

    osf = osfclient.OSF(username=USER, password=PASSWORD, token=TOKEN)

    args_indexosf = args(
        username=USER, 
        project=PROJECT, 
        remote='/'
    )

    storage, remote_path = utils.split_storage(args_indexosf.remote)
    osf = cli._setup_osf(args_indexosf)
    osf_project = osf.project(args_indexosf.project)
    osf_storage = osf_project.storage(storage)

    filelist_osf = list()
    for osf_file in osf_storage.files:
        filelist_osf.append(osf_file.path)

The list of folder contents always seems to always be missing so items with the folder contains more than ~110 files.

For instance, indexing an OSF folder containing

235_1.png
235_2.png
236_1.png
236_2.png
237_1.png
237_2.png
238_1.png
238_2.png
239_1.png
239_2.png
240_1.png
240_2.png
241_1.png
241_2.png
242_1.png
242_2.png
243_1.png
243_2.png
244_1.png
244_2.png
245_1.png
245_2.png
246_1.png
246_2.png
247_1.png
247_2.png
248_1.png
248_2.png
249_1.png
249_2.png
250_1.png
250_2.png
251_1.png
251_2.png
252_1.png
252_2.png
253_1.png
253_2.png
254_1.png
254_2.png
255_1.png
255_2.png
256_1.png
256_2.png
257_1.png
257_2.png
258_1.png
258_2.png
259_1.png
259_2.png
260_1.png
260_2.png
261_1.png
261_2.png
262_1.png
262_2.png
263_1.png
263_2.png
264_1.png
264_2.png
265_1.png
265_2.png
266_1.png
266_2.png
268_1.png
268_2.png
269_1.png
269_2.png
270_1.png
270_2.png
271_1.png
271_2.png
272_1.png
272_2.png
273_1.png
273_2.png
275_1.png
275_2.png
276_1.png
276_2.png
277_1.png
277_2.png
278_1.png
278_2.png
279_1.png
279_2.png
280_1.png
280_2.png
281_1.png
281_2.png
282_1.png
282_2.png
283_1.png
283_2.png
284_1.png
284_2.png
285_1.png
285_2.png
286_1.png
286_2.png
287_1.png
287_2.png
288_1.png
288_2.png
289_1.png
289_2.png
generic_avatar_male.png

returns a list that's missing

263_1.png
265_2.png
286_1.png
284_1.png

[daeh]

Same issue as the second part of #200

[daeh]

fyi https://github.com/ropensci/osfr/ does not suffer from this incomplete indexing issue.

[mtiberti]

I'm having a similar problem for which some files (and always the same ones, in a repeatable manner) are not downloaded at all when doing osf clone. Might be connected to this