When The Algorithm Knows