A writer, newly arrived in France on a visiting fellowship, is determined to explore the capital with fresh eyes