I had trouble getting VIM behaving as expected under Cygwin. Specifically, the backspace and arrow keys were behaving badly in insert mode.
The solution was dead simple. In your root directory just run:
touch .vimrc