The PyTorch composability meeting is one of the most interesting discussions of how the various parts of PyTorch fit together, particularly in the context of the PyTorch compiler and associated technologies. The meetings themselves are public, and so are the meeting notes, which are a great reference point.
https://docs.google.com/document/u/0/d/1QTR3t3KdRu5JT1lvAuJLsPd3LruCfv0LecpsgR8eWhg/