Recently, there are many technical problems involved in realizing flexible manufacturing systems in factories. Our production lines suffer from requirements for higher productivity and quality, lower cost, and the shortage of well trained operators. Among these serious problems, manual adjustment automation reflects key technologies. In this paper, problems regarding manual adjustment are summarized and image processing technologies are presented as a very powerful tool to automate the adjustment work.