You can for sure do caching. There are many sites with high traffic running on Github Pages. I wouldn’t worry about performance at first. Worry about building something people care about. If you’re evaluating other options check out website hosting with Amazon S3 or Netlify for static site deployments. For both the cost is next to nothing.