Providing guidance to learners navigating a game-based learning environment requires walking a fine line between encouraging progression toward learning goals without disrupting playful engagement in the game. In this paper, we present a scaffolding guidebook developed for tutors to provide guidance in game-based learning environments that encourages exploration of the problem space and solving puzzles without disrupting engagement. Scaffolding strategies were coded and categorized from Baba is You gameplay recordings of 13 middle school and 12 undergraduate students and then situated based on guiding principles from relevant literature into a scaffolding guide. Here, we describe this guidebook and its development, which could provide educators with important tools that can help their students progress through game-based learning environments without interfering with engagement.