Application of state-of-the-art genome editing tools like CRISPR-Cas9 drastically increase the number of undomesticated micro-organisms amenable to highly efficient and rapid genetic engineering. Adaptation of these tools to new bacterial families can open up entirely new possibilities for these organisms to accelerate as biotechnologically relevant microbial factories, also making new products economically competitive. Here, we report the implementation of a CRISPR-Cas9 based vector system in Paenibacillus polymyxa, enabling fast and reliable genome editing in this host. Homology directed repair allows for highly efficient deletions of single genes and large regions as well as insertions. We used the system to investigate the yet undescribed biosynthesis machinery for exopolysaccharide (EPS) production in P. polymyxa DSM 365, enabling assignment of putative roles to several genes involved in EPS biosynthesis. Using this simple gene deletion strategy, we generated EPS variants that differ from the wild-type polymer not only in terms of monomer composition, but also in terms of their rheological behavior. The developed CRISPR-Cas9 mediated engineering approach will significantly contribute to the understanding and utilization of socially and economically relevant Paenibacillus species and extend the polymer portfolio.