To experiment I made a similar window on a 226 cartridge and it worked very nicely.
I drilled out a 1/4" diameter hole through both sides. Then using hot melt glue I was able to attach some clear windows on the side. Since a very thin film of glue is required to keep the window as flush as possible to the side, it can cause rapid cooling issues. Let the hot melt glue get as hot as possible so a lot of preheating is necessary. I used some very thin packaging and cut out a window. The issue is that by the time I put the window on, the glue would partially cool. Now the window could not be sealed. So I cleaned off the tip of the glue gun and then pressed it against the window and remelted the glue underneath, I was now able to perfectly seal the window against the side.
After I did it, I then remembered I have some material that might be better. It was thinner, which is better and it could withstand up to 320 degrees .. a hot clothes iron. This material is called TEC200. You use this stuff to make electronic circuit boards. Using a laser printer, you print the plastic toner onto it and then it is placed on a circuit board and using an iron, you melt the toner onto the circuit board and then etch out the circuit pattern using chemicals. Overhead projector film might work equally as good.
Done properly, there is sufficient space between cartridges to apply external windows. I will now try these on the 251 cartridges.