Entrepreneurship is generally considered as central to economic development. Therefore, decisions by government to directly support entrepreneurs with Electronic Government (e-Gov) services can have significant impact on economic development. Given the current downward trend in new entrepreneur numbers in many countries, e-Gov services may arguably be best targeted at promotion and lowering of barriers in establishing new businesses. However, delivering effective e-Gov services to entrepreneurs in starting new businesses will require concrete knowledge of entrepreneurial needs on one hand and the barriers to entry and challenges on the other hand. Unfortunately, research dedicated to the real needs of entrepreneurs with respect to e-Gov services is limited. This work fills this knowledge gap through a study of the e-Gov related factors that could contribute to lowering the barriers to entry for new entrepreneurs. Based on the analysis of the information gathered from a series of structured and semi-structured interviews involving 36 fresh entrepreneurs in Finland, we identified four factors related to e-Gov services which could lower the barrier to entrepreneurship.