Answering to myself :]
Add a new filter for, say, field_file:fid, make it exposed and choose Is not empty operator.
It will not work :D It is a known Views issue. Luckily, comment #60comment #70 in that issue has a patch to fix this operator behavior, apply it and enjoy :)