I have recently started BIAB, and my wort is very cloudy after the boil. Much "cloud material" ends up in the fermentor, since it takes really long to settle and is easily stirred. It mostly looks like flour, and is present even without hops (I have tested).

Question: Is it OK to filter the wort after chilling, or will I remove some important stuff? (I could also filter just the last part.)

Will Irish Moss or WhirFloc help with this problem?