Simple methods fail to accurately segment the black pixels in our scans. We tried a large number of simple techniques, including thresholding, training classifiers for detecting black pixels, modeling the black ink layer as an MRF with unary data terms and binary smoothness terms, and using heuristics based on analyzing straight line profiles.
To drive this point home we are showing results of some of these failed attempts: