Multiplexed Application Substrate over QUIC Encryption A. R. Sedeño Internet-Draft Google LLC Intended status: Standards Track 1 May 2023 Expires: 2 November 2023 Proxying Ethernet in HTTP draft-asedeno-masque-connect-ethernet-00 Abstract This document describes how to proxy Ethernet frames in HTTP. This protocol is similar to IP proxying in HTTP, but allows transmitting arbitrary Ethernet frames. More specifically, this document defines a protocol that allows an HTTP client to create Layer 2 Ethernet tunnel through and HTTP server that acts as an Ethernet switch. About This Document This note is to be removed before publishing as an RFC. The latest revision of this draft can be found at https://asedeno.github.io/draft-asedeno-masque-connect-ethernet/ draft-asedeno-masque-connect-ethernet.html. Status information for this document may be found at https://datatracker.ietf.org/doc/draft- asedeno-masque-connect-ethernet/. Discussion of this document takes place on the MASQUE Working Group mailing list (mailto:masque@ietf.org), which is archived at https://mailarchive.ietf.org/arch/browse/masque/. Subscribe at https://www.ietf.org/mailman/listinfo/masque/. Source for this draft and an issue tracker can be found at https://github.com/asedeno/draft-asedeno-masque-connect-ethernet. Status of This Memo This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79. Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet- Drafts is at https://datatracker.ietf.org/drafts/current/. Sedeño Expires 2 November 2023 [Page 1] Internet-Draft CONNECT-ETHERNET May 2023 Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." This Internet-Draft will expire on 2 November 2023. Copyright Notice Copyright (c) 2023 IETF Trust and the persons identified as the document authors. All rights reserved. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/ license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Revised BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Revised BSD License. Table of Contents 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 3 2. Conventions and Definitions . . . . . . . . . . . . . . . . . 3 3. Configuration of Clients . . . . . . . . . . . . . . . . . . 4 4. Tunnelling Ethernet over HTTP . . . . . . . . . . . . . . . . 4 4.1. Ethernet Proxy Handling . . . . . . . . . . . . . . . . . 4 4.2. HTTP/1.1 Request . . . . . . . . . . . . . . . . . . . . 5 4.3. HTTP/1.1 Response . . . . . . . . . . . . . . . . . . . . 6 4.4. HTTP/2 and HTTP/3 Requests . . . . . . . . . . . . . . . 6 4.5. HTTP/2 and HTTP/3 Responses . . . . . . . . . . . . . . . 7 5. Context Identifiers . . . . . . . . . . . . . . . . . . . . . 8 6. HTTP Datagram Payload Format . . . . . . . . . . . . . . . . 8 7. Ethernet Frame Handling . . . . . . . . . . . . . . . . . . . 9 7.1. Link Status and Error Signalling . . . . . . . . . . . . 9 7.2. Broadcast and Multicast . . . . . . . . . . . . . . . . . 9 8. Examples . . . . . . . . . . . . . . . . . . . . . . . . . . 9 8.1. Layer 2 VPN . . . . . . . . . . . . . . . . . . . . . . . 9 9. Security Considerations . . . . . . . . . . . . . . . . . . . 11 10. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 11 10.1. HTTP Upgrade Token . . . . . . . . . . . . . . . . . . . 11 10.2. Updates to the MASQUE URI Suffixes Registry . . . . . . 11 11. References . . . . . . . . . . . . . . . . . . . . . . . . . 11 11.1. Normative References . . . . . . . . . . . . . . . . . . 11 11.2. Informative References . . . . . . . . . . . . . . . . . 13 Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . . . 13 Author's Address . . . . . . . . . . . . . . . . . . . . . . . . 13 Sedeño Expires 2 November 2023 [Page 2] Internet-Draft CONNECT-ETHERNET May 2023 1. Introduction HTTP provides the CONNECT method (see Section 9.3.6 of [HTTP]) for creating a TCP [TCP] tunnel to a destination, a similar mechanism for UDP [CONNECT-UDP], and an additional mechanism for IP [CONNECT-IP]. However, these mechanisms can't carry layer 2 frames without further encapsulation inside of IP, for instance with EtherIP [ETHERIP], GUE [GUE] or L2TP [L2TP] [L2TPv3], which imposes an additional MTU cost. This document describes a protocol for tunnelling Ethernet frames through an HTTP server acting as an Ethernet switch over HTTP. This can be used to establish a Layer 2 VPN, which can then bridge two Ethernet broadcast domains. This can simplify connectivity to network-connected appliances that are configured to only interact with peers on the same Ethernet broadcast domain. This protocol supports all existing versions of HTTP by using HTTP Datagrams [HTTP-DGRAM]. When using HTTP/2 [HTTP/2] or HTTP/3 [HTTP/3], it uses HTTP Extended CONNECT as described in [EXT-CONNECT2] and [EXT-CONNECT3]. When using HTTP/1.x [HTTP/1.1], it uses HTTP Upgrade as defined in Section 7.8 of [HTTP]. 2. Conventions and Definitions The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in BCP 14 [RFC2119] [RFC8174] when, and only when, they appear in all capitals, as shown here. In this document, we use the term "Ethernet proxy" to refer to the HTTP server that responds to the Ethernet proxying request. The term "client" is used in the HTTP sense; the client constructs the Ethernet proxying request. If there are HTTP intermediaries (as defined in Section 3.7 of [HTTP]) between the client and the Ethernet proxy, those are referred to as "intermediaries" in this document. The term "Ethernet proxying endpoints" refers to both the client and the Ethernet proxy. This document uses terminology from [QUIC]. Where this document defines protocol types, the definition format uses the notation from Section 1.3 of [QUIC]. This specification uses the variable-length integer encoding from Section 16 of [QUIC]. Variable-length integer values do not need to be encoded in the minimum number of bytes necessary. Sedeño Expires 2 November 2023 [Page 3] Internet-Draft CONNECT-ETHERNET May 2023 Note that, when the HTTP version in use does not support multiplexing streams (such as HTTP/1.1), any reference to "stream" in this document represents the entire connection. 3. Configuration of Clients Clients are configured to use Ethernet proxying over HTP via a URL. Examples are shown below: https://example.org/.well-known/masque/ethernet/ https://proxy.example.org:4443/masque/ethernet/ https://proxy.example.org:4443/masque/ethernet/ https://masque.example.org/?user=bob 4. Tunnelling Ethernet over HTTP To allow negotiation of a tunnel for Ethernet over HTTP, this document defines the "connect-ethernet" HTTP upgrade token. The resulting Ethernet tunnels use the Capsule Protocol (see Section 3.2 of [HTTP-DGRAM]) with HTTP Datagrams in the format defined in Section 6. To initiate an Ethernet tunnel associated with a single HTTP stream, a client issues a request containing the "connect-ethernet" upgrade token. By virtue of the definition of the Capsule Protocol (see Section 3.2 of [HTTP-DGRAM]), Ethernet proxying requests do not carry any message content. Similarly, successful Ethernet proxying responses also do not carry any message content. Ethernet proxying over HTTP MUST be operated over TLS or QUIC encryption, or another equivalent encryption protocol, to provide confidentiality, integrity, and authentication. 4.1. Ethernet Proxy Handling Upon receiving an Ethernet proxying request: * if the recipient is configured to use another HTTP proxy, it will act as an intermediary by forwarding the request to another HTTP server. Note that such intermediaries may need to re-encode the request if they forward it using a version of HTTP that is different from the one used to receive it, as the request encoding differs by version (see below). Sedeño Expires 2 November 2023 [Page 4] Internet-Draft CONNECT-ETHERNET May 2023 * otherwise, the recipient will act as an Ethernet proxy. The Ethernet proxy can choose to reject the Ethernet proxying request or establish an Ethernet tunnel. The lifetime of the Ethernet tunnel is tied to the Ethernet proxying request stream. A successful response (as defined in Sections 4.3 and 4.5) indicates that the Ethernet proxy has established an Ethernet tunnel and is willing to proxy Ethernet frames. Any response other than a successful response indicates that the request has failed; thus, the client MUST abort the request. 4.2. HTTP/1.1 Request When using HTTP/1.1 [HTTP/1.1], an Ethernet proxying request will meet the following requirements: * the method SHALL be "GET". * the request SHALL include a single Host header field containing the host and optional port of the Ethernet proxy. * the request SHALL include a Connection header field with value "Upgrade" (note that this requirement is case-insensitive as per Section 7.6.1 of [HTTP]). * the request SHALL include an Upgrade header field with value "connect-ethernet". An Ethernet proxying request that does not conform to these restrictions is malformed. The recipient of such a malformed request MUST respond with an error and SHOULD use the 400 (Bad Request) status code. For example, if the client is configured with the URL "https://example.org/.well-known/masque/ethernet/" and wishes to open an Ethernet tunnel, it could send the following request. GET https://example.org/.well-known/masque/ethernet/ HTTP/1.1 Host: example.org Connection: Upgrade Upgrade: connect-ethernet Capsule-Protocol: ?1 Figure 1: Example HTTP/1.1 Request Sedeño Expires 2 November 2023 [Page 5] Internet-Draft CONNECT-ETHERNET May 2023 4.3. HTTP/1.1 Response The server indicates a successful response by replying with the following requirements: * the HTTP status code on the response SHALL be 101 (Switching Protocols). * the response SHALL include a Connection header field with value "Upgrade" (note that this requirement is case-insensitive as per Section 7.6.1 of [HTTP]). * the response SHALL include a single Upgrade header field with value "connect-ethernet". * the response SHALL meet the requirements of HTTP responses that start the Capsule Protocol; see Section 3.2 of [HTTP-DGRAM]. If any of these requirements are not met, the client MUST treat this proxying attempt as failed and close the connection. For example, the server could respond with: HTTP/1.1 101 Switching Protocols Connection: Upgrade Upgrade: connect-ethernet Capsule-Protocol: ?1 Figure 2: Example HTTP/1.1 Response 4.4. HTTP/2 and HTTP/3 Requests When using HTTP/2 [HTTP/2] or HTTP/3 [HTTP/3], Ethernet proxying requests use HTTP Extended CONNECT. This requires that servers send an HTTP Setting as specified in [EXT-CONNECT2] and [EXT-CONNECT3] and that requests use HTTP pseudo-header fields with the following requirements: * The :method pseudo-header field SHALL be "CONNECT". * The :protocol pseudo-header field SHALL be "connect-ethernet". * The :authority pseudo-header field SHALL contain the authority of the IP proxy. * The :path and :scheme pseudo-header fields SHALL NOT be empty. Their values SHALL contain the scheme and path from the configured URL; see Section 3. Sedeño Expires 2 November 2023 [Page 6] Internet-Draft CONNECT-ETHERNET May 2023 An Ethernet proxying request that does not conform to these restrictions is malformed; see Section 8.1.1 of [HTTP/2] and Section 4.1.2 of [HTTP/3]. For example, if the client is configured with the URL "https://example.org/.well-known/masque/ethernet/" and wishes to open an Ethernet tunnel, it could send the following request. HEADERS :method = CONNECT :protocol = connect-ethernet :scheme = https :path = /.well-known/masque/ethernet/ :authority = example.org capsule-protocol = ?1 Figure 3: Example HTTP/2 or HTTP/3 Request 4.5. HTTP/2 and HTTP/3 Responses The server indicates a successful response by replying with the following requirements: * the HTTP status code on the response SHALL be in the 2xx (Successful) range. * the response SHALL meet the requirements of HTTP responses that start the Capsule Protocol; see Section 3.2 of [HTTP-DGRAM]. If any of these requirements are not met, the client MUST treat this proxying attempt as failed and abort the request. As an example, any status code in the 3xx range will be treated as a failure and cause the client to abort the request. For example, the server could respond with: HEADERS :status = 200 capsule-protocol = ?1 Figure 4: Example HTTP/2 or HTTP/3 Response Sedeño Expires 2 November 2023 [Page 7] Internet-Draft CONNECT-ETHERNET May 2023 5. Context Identifiers The mechanism for proxying Ethernet in HTTP defined in this document allows future extensions to exchange HTTP Datagrams that carry different semantics from Ethernet frames. Some of these extensions can augment Ethernet payloads with additional data or compress Ethernet frame header fields, while others can exchange data that is completely separate from Ethernet payloads. In order to accomplish this, all HTTP Datagrams associated with Ethernet proxying requests streams start with a Context ID field; see Section 6. Context IDs are 62-bit integers (0-2^62-1). Context IDs are encoded as variable-length integers; see Section 16 of [QUIC]. The Context ID value of 0 is reserved for Ethernet payloads, while non-zero values are dynamically allocated. Non-zero even-numbered Context-IDs are client allocated, and odd-numbered Context IDs are proxy- allocated. The Context ID namespace is tied to a given HTTP request; it is possible for a Context ID with the same numeric value to be simultaneously allocated in distinct requests, potentially with different semantics. Context IDs MUST NOT be re-allocated within a given HTTP request but MAY be allocated in any order. The Context ID allocation restrictions to the use of even-numbered and odd-numbered Context IDs exist in order to avoid the need for synchronization between endpoints. However, once a Context ID has been allocated, those restrictions do not apply to the use of the Context ID; it can be used by either the client or the Ethernet proxy, independent of which endpoint initially allocated it. Registration is the action by which an endpoint informs its peer of the semantics and format of a given Context ID. This document does not define how registration occurs. Future extensions MAY use HTTP header fields or capsules to register Context IDs. Depending on the method being used, it is possible for datagrams to be received with Context IDs that have not yet been registered. For instance, this can be due to reordering of the packet containing the datagram and the packet containing the registration message during transmission. 6. HTTP Datagram Payload Format When associated with Ethernet proxying request streams, the HTTP Datagram Payload field of HTTP Datagrams (see [HTTP-DGRAM]) has the format defined in Figure 5. Note that when HTTP Datagrams are encoded using QUIC DATAGRAM frames, the Context ID field defined below directly follows the Quarter Stream ID field which is at the start of the QUIC DATAGRAM frame payload. Sedeño Expires 2 November 2023 [Page 8] Internet-Draft CONNECT-ETHERNET May 2023 Ethernet Proxying HTTP Datagram Payload { Context ID (i), Payload (..), } Figure 5: Ethernet Proxying HTTP Datagram Format The Ethernet Proxying HTTP Datagram Payload contains the following fields: Context ID: A variable-length integer that contains the value of the Context ID. If an HTTP/3 datagram which carries an unknown Context ID is received, the receiver SHALL either drop that datagram silently or buffer it temporarily (on the order of a round trip) while awaiting the registration of the corresponding Context ID. Payload: The payload of the datagram, whose semantics depend on value of the previous field. Note that this field can be empty. Ethernet frames are encoded using HTTP Datagrams with the Context ID set to zero. When the Context ID is set to zero, the Payload field contains a full Layer 2 Ethernet Frame (from the MAC destination field until the last byte of the Frame check sequence field). 7. Ethernet Frame Handling This document defines a tunneling mechanism that is conceptually an Ethernet link. Implementations might need to handle some of the responsibilities of an Ethernet switch if they do not delegate them to another implementation such as a kernel. 7.1. Link Status and Error Signalling * Maybe borrow some bits from L2TPv3 [L2TPv3] for fault signalling via capsule. 7.2. Broadcast and Multicast 8. Examples Some examples; if you can, a Layer 3 option is probably better, but hey, Layer 2. 8.1. Layer 2 VPN The following example shows how a point to point VPN setup where a client appears to be connected to a remote Layer 2 network. Sedeño Expires 2 November 2023 [Page 9] Internet-Draft CONNECT-ETHERNET May 2023 +--------+ +--------+ +---> HOST 1 | +--------------------+ L2 | Layer 2 | | Client |<--Layer 2 Tunnel---| Proxy +------------+---> HOST 2 | +--------------------+ | Broadcast | +--------+ +--------+ Domain +---> HOST 3 Figure 6: L2 VPN Tunnel Setup In this case, the client connects to the Ethernet proxy and immediately can start sending ethernet frames to the attached broadcast domain. [[ From Client ]] [[ From Ethernet Proxy ]] SETTINGS H3_DATAGRAM = 1 SETTINGS ENABLE_CONNECT_PROTOCOL = 1 H3_DATAGRAM = 1 STREAM(44): HEADERS :method = CONNECT :protocol = connect-ethernet :scheme = https :path = /.well-known/masque/ethernet/ :authority = proxy.example.com capsule-protocol = ?1 STREAM(44): HEADERS :status = 200 capsule-protocol = ?1 DATAGRAM Quarter Stream ID = 11 Context ID = 0 Payload = Encapsulated Ethernet Frame DATAGRAM Quarter Stream ID = 11 Context ID = 0 Payload = Encapsulated Ethernet Frame Figure 7: VPN Full-Tunnel Example Sedeño Expires 2 November 2023 [Page 10] Internet-Draft CONNECT-ETHERNET May 2023 9. Security Considerations TODO Security 10. IANA Considerations 10.1. HTTP Upgrade Token This document will request IANA to register "connect-ethernet" in the HTTP Upgrade Token Registry maintained at . Value: connect-ethernet Description: Proxying of Ethernet Payloads Expected Version Tokens: None References: This document 10.2. Updates to the MASQUE URI Suffixes Registry This document will request IANA to register "ethernet" in the MASQUE URI Suffixes Registry maintained at $IANA_URL_TBD, created by CONNECT-IP [CONNECT-IP]. +==============+===================+===============+ | Path Segment | Description | Reference | +==============+===================+===============+ | ethernet | Ethernet Proxying | This Document | +--------------+-------------------+---------------+ Table 1: New MASQUE URI Suffixes 11. References 11.1. Normative References [CONNECT-UDP] Schinazi, D., "Proxying UDP in HTTP", RFC 9298, DOI 10.17487/RFC9298, August 2022, . [EXT-CONNECT2] McManus, P., "Bootstrapping WebSockets with HTTP/2", RFC 8441, DOI 10.17487/RFC8441, September 2018, . Sedeño Expires 2 November 2023 [Page 11] Internet-Draft CONNECT-ETHERNET May 2023 [EXT-CONNECT3] Hamilton, R., "Bootstrapping WebSockets with HTTP/3", RFC 9220, DOI 10.17487/RFC9220, June 2022, . [HTTP] Fielding, R., Ed., Nottingham, M., Ed., and J. Reschke, Ed., "HTTP Semantics", STD 97, RFC 9110, DOI 10.17487/RFC9110, June 2022, . [HTTP-DGRAM] Schinazi, D. and L. Pardue, "HTTP Datagrams and the Capsule Protocol", RFC 9297, DOI 10.17487/RFC9297, August 2022, . [HTTP/1.1] Fielding, R., Ed., Nottingham, M., Ed., and J. Reschke, Ed., "HTTP/1.1", STD 99, RFC 9112, DOI 10.17487/RFC9112, June 2022, . [HTTP/2] Thomson, M., Ed. and C. Benfield, Ed., "HTTP/2", RFC 9113, DOI 10.17487/RFC9113, June 2022, . [HTTP/3] Bishop, M., Ed., "HTTP/3", RFC 9114, DOI 10.17487/RFC9114, June 2022, . [L2TP] Townsley, W., Valencia, A., Rubens, A., Pall, G., Zorn, G., and B. Palter, "Layer Two Tunneling Protocol "L2TP"", RFC 2661, DOI 10.17487/RFC2661, August 1999, . [L2TPv3] Lau, J., Ed., Townsley, M., Ed., and I. Goyret, Ed., "Layer Two Tunneling Protocol - Version 3 (L2TPv3)", RFC 3931, DOI 10.17487/RFC3931, March 2005, . [QUIC] Iyengar, J., Ed. and M. Thomson, Ed., "QUIC: A UDP-Based Multiplexed and Secure Transport", RFC 9000, DOI 10.17487/RFC9000, May 2021, . [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10.17487/RFC2119, March 1997, . Sedeño Expires 2 November 2023 [Page 12] Internet-Draft CONNECT-ETHERNET May 2023 [RFC8174] Leiba, B., "Ambiguity of Uppercase vs Lowercase in RFC 2119 Key Words", BCP 14, RFC 8174, DOI 10.17487/RFC8174, May 2017, . [TCP] Eddy, W., Ed., "Transmission Control Protocol (TCP)", STD 7, RFC 9293, DOI 10.17487/RFC9293, August 2022, . 11.2. Informative References [CONNECT-IP] Pauly, T., Schinazi, D., Chernyakhovsky, A., Kühlewind, M., and M. Westerlund, "Proxying IP in HTTP", Work in Progress, Internet-Draft, draft-ietf-masque-connect-ip-13, 28 April 2023, . [ETHERIP] Housley, R. and S. Hollenbeck, "EtherIP: Tunneling Ethernet Frames in IP Datagrams", RFC 3378, DOI 10.17487/RFC3378, September 2002, . [GUE] Herbert, T., Yong, L., and O. Zia, "Generic UDP Encapsulation", Work in Progress, Internet-Draft, draft- ietf-intarea-gue-09, 26 October 2019, . Acknowledgments Much of the initial version of this draft borrows heavily from [CONNECT-IP]. The author would like to thank Alexander Chernyakhovsky and David Schinazi for their advice while preparing this document. Author's Address Alejandro R Sedeño Google LLC Email: asedeno@google.com Sedeño Expires 2 November 2023 [Page 13]