'How to match 2 huge size list #2

I got a precious answer from Vishal Balaji who suggested me on to use of set() for improve speed in list intersection. For whom can't understand what does mean intersection , here is the link ;-).

delta = list(set(tit_comp)-set(out))

this helped me a lot, but now I need a further step up in velocity, because the lists to manage are in order of over 10^6 items(strings of max #10 char) each and the computing time is becoming incommensurabile (always for whom don't know it: means to much time to be count that imply the above intersection take too to long time to wait it finish for a reasonable time).. Even splitting the list in chunk the computing time is huge. I also facing with a mem overflow crash
any suggestion on how to solve the enpass ?

I'm finally asking if anyone knows a different way to treat the huge lists..

thanks



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source