Opinion by Chief Judge SCHROEDER. Dissent by Judge GRABER.
SCHROEDER, Chief Judge:This appeal raises the difficult and important issue of whether the incorporation of a short segment of a musical recording into a new musical recording, i.e., the practice of “sampling,” requires a license to use both the performance and the composition of the original recording. The particular sample in this case consists of a six-second, three-note segment of a performance of one of his own compositions by plaintiff, and accomplished jazz flutist, James W. Newton. The defendants, the performers who did the sampling, are the members of the musical group Beastie Boys. They obtained a license to sample the sound recording of Newton’s copyrighted performance, but they did not obtain a license to use Newton’s underlying composition, which is also copyrighted.
The district court granted summary judgment to the defendants. In a scholarly opinion, it held that no license to the underlying composition was required because, as a matter of law, the notes in question — C-D flat — C, over a held C note — lacked sufficient originality to merit copyright protection. Newton v. Diamond, 204 F.Supp.2d 1244, 1256 (C.D.Cal.2002). The district court also held that even if the sampled segment of the composition were original, Beastie Boys’ use was de minimis and therefore not actionable. Id. at 1259. We affirm on the ground that the use was de minimis.
Background and Procedural History
The plaintiff and appellant in this case, James W. Newton, is an accomplished avant-garde jazz flutist and composer. In 1978, he composed the song “Choir,” a piece for flute and voice intended to incorporate elements of African-American gospel music, Japanese ceremonial court music, traditional African music, and classical music, among others. According to Newton, the song was inspired by his earliest memory of music, watching four women singing in a church in rural Arkansas. In 1981, Newton performed and recorded “Choir” and licensed all rights in the sound recording to ECM Records for $5000.1 The license covered only the sound recording, and it is undisputed that Newton retained all rights to the composition of “Choir.” Sound recordings and their underlying compositions are separate works *593with their own distinct copyrights. 17 U.S.C. § 102(a)(2), (7).
The defendants and appellees include the members of the rap and hip-hop group Beastie Boys, and their business associates. In 1992, Beastie Boys obtained a license from ECM Records to use portions of the sound recording of “Choir” in various renditions of their song “Pass the Mic” in exchange for a one-time fee of $1000.2 Beastie Boys did not obtain a license from Newton to use the underlying composition.
The portion of the composition at issue consists of three notes, C-D flat — C, sung over a background C note played on the flute. When played on the sound recording licensed by Beastie Boys, the segment lasts for approximately six seconds. The score to “Choir” also indicates that the entire song should be played in a “largo/senza-misura” tempo, meaning “slowly/without-measure.” Apart from an instruction that the performer sing into the flute and finger simultaneously, the score is not further orchestrated.
The dispute between Newton and Beast-ie Boys centers around the copyright implications of the practice of sampling, a practice now common to many types of popular music. Sampling entails the incorporation of short segments of prior sound recordings into new recordings. The practice originated in Jamaica in the 1960s, when disc jockeys (DJs) used portable sound systems to mix segments of prior recordings into new mixes, which they would overlay with chanted or ‘scatted’ vocals. See Robert M. Szymanski, Audio Pasitiche: Digital Sampling, Intermediate Copying, Fair Use, 8 U.C.L.A. Ent. L. Rev. 271, 277 (Spring 1996). Sampling migrated to the United States and developed throughout the 1970s, using the analog technologies of the time. Id. The digital sampling involved here developed in the early 1980s with the advent of digital synthesizers having MIDI (Musical Instrument Digital Interface) keyboard controls. These digital instruments allowed artists digitally to manipulate and combine sampled sounds, expanding the range of possibilities for the use of pre-recorded music. Whereas analog devices limited artists to “scratching” vinyl records and “cutting” back and forth between different sound recordings, digital technology allowed artists to slow down, speed up, combine, and otherwise alter the samples. See id.
Pursuant to their license from ECM Records, Beastie Boys digitally sampled the opening six seconds of Newton’s sound recording of “Choir.” Beastie Boys repeated or “looped” this six-second sample as a background element throughout “Pass the Mic,” so that it appears over forty times in various renditions of the song. In addition to the version of “Pass the Mic” released on their 1992 album, “Check Your Head,” Beastie Boys included the “Choir” sample in two remixes, “Dub the Mic” and “Pass the Mic (Pt. 2, Skills to Pay the Bills).” It is unclear whether the sample *594was altered or manipulated, though Beast-ie Boys’ sound engineer stated that alterations of tone, pitch, and rhythm are commonplace, and Newton maintains that the pitch was lowered slightly.
Newton filed the instant action in federal court on May 9, 2000, alleging violations of his copyright in the underlying composition, as well as Lanham Act violations for misappropriation and reverse passing off. The district court dismissed Newton’s Lanham Act claims on September 12, 2000, and granted summary judgment in favor of Beastie Boys on the copyright claims on May 21, 2002. Newton v. Diamond, 204 F.Supp.2d 1244 (C.D.Cal.2002). The district court held that the three-note segment of the “Choir” composition could not be copyrighted because, as a matter of law, it lacked the requisite originality. 204 F.Supp.2d at 1256. The court also concluded that even if the segment were copyrightable, Beastie Boys’ use of the work was de minimis and therefore not actionable. Id. at 1259. Newton appealed.
Whether Defendants’ Use was De Min-imis
We may affirm the grant of summary judgment on any basis supported by the record and need not reach each ground relied upon by the district court. See Venetian Casino Resort L.L.C. v. Local Joint Executive Bd. of Las Vegas, 257 F.3d 937, 941 (9th Cir.2001), cert. denied, 535 U.S. 905, 122 S.Ct. 1204, 152 L.Ed.2d 142 (2002). Assuming that the sampled segment of the composition was sufficiently original to merit copyright protection, we nevertheless affirm on the ground that Beastie Boys’ use was de minimis and therefore not actionable.
For an unauthorized use of a copyrighted work to be actionable, there must be substantial similarity between the plaintiffs and the defendants’ works. See Ringgold v. Black Entm’t Television, Inc., 126 F.3d 70, 74 (2d Cir.1997); Ideal Toy Corp. v. Fab-Lu Ltd. (Inc.), 360 F.2d 1021, 1022(2d Cir.1966). This means that even where the fact of copying is conceded, no legal consequences will follow from that fact unless the copying is substantial. See Laureyssens v. Idea Group, Inc., 964 F.2d 131, 140 (2d Cir.1992); 4 Melville B. Nim-mer & David Nimmer, Nimmer on Copyright § 13.03[A], at 13-30.2. The principle that trivial copying does not constitute actionable infringement has long been a part of copyright law. Indeed, as Judge Learned Hand observed over 80 years ago: “Even where there is some copying, that fact is not conclusive of infringement. Some copying is permitted. In addition to copying, it must be shown that this has been done to an unfair extent.” West Publ’g Co. v. Edward Thompson Co., 169 F. 833, 861 (E.D.N.Y.1909). This principle reflects the legal maxim, de minimis non curat lex (often rendered as, “the law does not concern itself with trifles”). See Ring-gold, 126 F.3d at 74-75.
The leading case on de minimis infringement in our circuit is Fisher v. Dees, 794 F.2d 432 (9th Cir.1986), where we observed that a use is de minimis only if the average audience would not recognize the appropriation. See id. at 434 n.2 (“[A] taking is considered de minimis only if it is so meager and fragmentary that the average audience would not recognize the appropriation.”). This observation reflects the relationship between the de minimis maxim and the general test for substantial similarity, which also looks to the response of the average audience, or ordinary observer, to determine whether a use is infringing. See, e.g., Cavalier v. Random House, Inc., 297 F.3d 815, 822 (9th Cir.2002); Castle Rock Entm’t, Inc. v. Carol Publ’g Group, Inc., 150 F.3d 132(2d Cir.1998) (“Two works are substantially similar where ‘the ordinary observer, unless he *595set out to detect the disparities, would be disposed to overlook them, and regard [the] aesthetic appeal [of the two works] as the same.’ ” (quoting Arica Inst., Inc. v. Palmer, 970 F.2d 1067, 1072 (2d Cir.1992) (quoting Peter Pan Fabrics, Inc. v. Martin Weiner Corp., 274 F.2d 487, 489 (2d Cir.1960) (L. Hand, J.)))). To say that a use is de minimis because no audience would recognize the appropriation is thus to say that the works are not substantially similar.
On the facts of Fisher, this court rejected the de minimis defense because the copying was substantial: the defendant had appropriated the main theme and lyrics of the plaintiffs song, both of which were easily recognizable in the defendant’s parody. 794 F.2d at 434 & n.2. Specifically, the defendant copied six of the thirty-eight bars to the 1950s standard, “When Sunny Gets Blue,” to make the parody, “When Sonny Sniffs Glue,” and paralleled the original lyrics with only minor variations. Id. However, despite the works’ substantial similarities, we held that the use was nevertheless non-infringing because, as a parody, it was “fair use” under 17 U.S.C. § 107. Id. at 440. We explained that the defendant’s successful fair use defense precluded a finding that the use was insubstantial or unrecognizable because “the parodist must appropriate a substantial enough portion of [the original] to evoke recognition.” Id. at 435 n.2.
This case involves not only use of a composition, as was the case in Fisher, but also use of a sound recording of a performance of that composition. Because the defendants licensed the sound recording, our inquiry is confined to whether the unauthorized use of the composition itself was substantial enough to sustain an infringement claim. Therefore, we may consider only Beastie Boys’ appropriation of the song’s compositional elements and must remove from consideration all the elements unique to Newton’s performance. Stated another way, we must “filter out” the licensed elements of the sound recording to get down to the unlicensed elements of the composition, as the composition is the sole basis for Newton’s infringement claim. See Cavalier, 297 F.3d at 822; Apple Computer, Inc. v. Microsoft Corp., 35 F.3d 1435, 1446 (9th Cir.1994).
In filtering out the unique performance elements from consideration, and separating them from those found in the composition, we find substantial assistance in the testimony of Newton’s own experts. His experts reveal the extent to which the sound recording of “Choir” is the product of Newton’s highly developed performance techniques, rather than the result of a generic rendition of the composition. As a general matter, according to Newton’s expert Dr. Christopher Dobrian, “[t]he contribution of the performer is often so great that s/he in fact provides as much musical content as the composer.” This is particularly true with works like “Choir,” given the nature of jazz performance and the minimal scoring of the composition. Indeed, as Newton’s expert Dr. Oliver Wilson explained:
[T]he copyrighted score of “Choir”, as is the custom in scores written in the jazz tradition, does not contain indications for all of the musical subtleties that it is assumed the performer-composer of the work will make in the work’s performance. The function of the score is more mnemonic in intention than prescriptive.
And it is clear that Newton goes beyond the score in his performance. For example, Dr. Dobrian declared that “Mr. Newton blows and sings in such a way as to emphasize the upper partíais of the flute’s complex harmonic tone, [although] such a modification of tone color is not explicitly requested in the score.” More generally, *596Dr. Wilson explained Newton’s performance technique as follows:
[T]he Newton technique produces a musical event in which the component sounds resulting from the simultaneous singing of one or more pitches and the interaction of this pitch or pitches with the various components of the multi-phonic array of pitches produced on the flute create a relatively dense cluster of pitches and ambient sounds that sometimes change over time.
Whatever copyright interest Newton obtained in this “dense cluster of pitches and ambient sounds,” he licensed that interest to ECM Records over twenty years ago, and ECM Records in turn licensed that interest to Beastie Boys. Thus, regardless of whether the average audience might recognize “the Newton technique” at work in the sampled sound recording, those performance elements are beyond consideration in Newton’s claim for infringement of his copyright in the underlying composition. Having licensed away his interest in the recording of his performance, Newton’s only claim is for a violation of his rights in the three-note sequence transcribed in the composition.
Once we have isolated the basis of Newton’s infiingement action — the “Choir” composition, devoid of the unique performance elements found only in the sound recording — we turn to the nub of our inquiry: whether Beastie Boys’ unauthorized use of the composition, as opposed to their authorized use of the sound recording, was substantial enough to sustain an infringement action. In answering that question, we must distinguish between the degree and the substantiality of the works’ similarity. Cf Ringgold, 126 F.3d at 74-75; 4 Nimmer § 13.03[A][2], at 13-45. The practice of music sampling will often present cases where the degree of similarity is high. Indeed, unless the sample has been altered or digitally manipulated, it will be identical to the original. Yet as Nimmer explains, “[if] the similarity is only as to nonessential matters, then a finding of no substantial similarity should result.” 4 Nimmer § 13.03[A][2], at 13-48; cf. Warner Bros. v. Am. Broad. Cos., 720 F.2d 231, 242 (2d Cir.1983). This reflects the principle that the substantiality requirement applies throughout the law of copyright, including cases of music sampling, even where there is a high degree of similarity.
The high degree but limited scope of similarity between the works here place Newton’s claim for infringement into the class of cases that allege what Nimmer refers to as “fragmented,literal similarity.” 4 Nimmer § 13.03[A][2], at 13-45. Fragmented literal similarity exists where the defendant copies a portion of the plaintiffs work exactly or nearly exactly, without appropriating the work’s overall essence or structure. Id. Because the degree of similarity is high in such cases, the dispositive question is whether the similarity goes to trivial or substantial elements. The sub-stantiality of the similarity is measured by considering the qualitative and quantitative significance of the copied portion in relation to the plaintiffs work as a whole. See, e.g., Worth v. Selchow & Righter Co., 827 F.2d 569, 570 n. 1 (9th Cir.1987) (“[T]he relevant inquiry is whether a substantial portion of the protectible material in the plaintiffs work was appropriated— not whether a substantial portion of defendant’s work was derived from plaintiffs work.”); Jarvis v. A & M Records, 827 F.Supp. 282, 289-90 (D.N.J.1993); 4 Nimmer § 13.03[A][2], at 13-47 to 48 & n. 97. This focus on the sample’s relation to the plaintiffs work as a whole embodies the fundamental question in any infringement action, as expressed more than 150 years ago by Justice Story: whether “so much is taken[] that the value of the original is *597sensibly diminished, or the labors of the original author are substantially to an injurious extent appropriated by another.” Folsom v. Marsh, 9 F.Cas. 342, 348 (C.C.Mass.1841) (No. 4901). Courts also focus on the relationship to the plaintiffs work because a contrary rule that measured the significance of the copied segment in the defendant’s work would allow an unscrupulous defendant to copy large or qualitatively significant portions of another’s work and escape liability by burying them beneath non-infringing material in the defendant’s own work, even where the average audience might recognize the appropriation. Cf. Sheldon v. Metro-Goldvjyn Pictures Corp., 81 F.2d 49, 56 (2d Cir.1936) (“[I]t is enough that substantial parts were lifted; no plagiarist can excuse the wrong by showing how much of his work he did not pirate.”). Thus, as the district court properly concluded, the fact that Beastie Boys “looped” the sample throughout “Pass the Mic” is irrelevant in weighing the sample’s qualitative and quantitative significance. See Newton, 204 F.Supp.2d at 1257.
When viewed in relation to Newton’s composition as a whole, the sampled portion is neither quantitatively nor qualitatively significant. Quantitatively, the three-note sequence appears only once in Newton’s composition. It is difficult to measure the precise relationship between this segment and the composition as a whole, because the score calls for between 180 and 270 seconds of improvisation. When played, however, the segment lasts six seconds and is roughly two percent of the four-and-a-half-minute “Choir” sound recording licensed by Beastie Boys. Qualitatively, this section of the composition is no more significant than any other section. Indeed, with the exception of two notes, the entirety of the scored portions of “Choir” consist of notes separated by whole and half-steps from their neighbors; the remainder of the composition calls for sections of improvisation that range between 90 and 180 seconds in length. Although the sampled section may be representative of the scored portions of the composition, Newton has failed to offer any evidence as to this section’s particular significance in the composition as a whole. Instead, his experts emphasize the significance of Newton’s performance, the unique elements of which Beastie Boys properly licensed.
Yet Newton maintains that the testimony of his experts creates a genuine issue of material fact on the substantiality of the copying. To the extent the expert testimony is relevant, it is not helpful to Newton. On the key question of whether the sample is quantitatively or qualitatively significant in relation to the composition as a whole, his experts are either silent or fail to distinguish between the sound recording, which was licensed, and the composition, which was not. Moreover, their testimony on the composition does not contain anything from which a reasonable jury could infer the segment’s significance in relation to the composition as a whole: rather, Dr. Dobrian described the three-note sequence at issue as “a simple ‘neighboring tone’ figure.” The district court cited two pieces by Gyorgy Ligeti and Jacob Druckman employing similar figures. Newton, 204 F.Supp.2d at 1255. This evidence is consistent with the opinion of Beastie Boys’ expert, Dr. Lawrence Ferrara, who stated that the sampled excerpt from the “Choir” composition “is merely a common, trite, and generic three-note sequence, which lacks any distinct melodic, harmonic, rhythmic or structural elements.” Dr. Ferrara also described the sequence as “a common building block tool” used over and over again by major composers in the 20th century, particularly *598the '60s and '70s, just prior to James Newton’s usage.
Having failed to demonstrate any quantitative or qualitative significance of the sample in the “Choir” composition as a whole, Newton is in a weak position to argue that the similarities between the works are substantial, or that an average audience would recognize the appropriation. In this respect, the minimal scoring of the “Choir” composition bears emphasis, as does the relative simplicity of the relevant portion of the composition. On the undisputed facts of this case, we conclude that an average audience would not discern Newton’s hand as a composer, apart from his talent as a performer, from Beastie Boys’ use of the sample. . The works are not substantially similar: Beast-ie Boys’ use of the “Choir” composition was de minimis. There is no genuine issue of material fact, and the grant of summary judgment was appropriate.
Conclusion
Because Beastie Boys’ use of the sound recording was authorized, the sole basis of Newton’s infringement action is his remaining copyright interest in the “Choir” composition. We hold today that Beastie Boys’ use of a brief segment of that composition, consisting of three notes separated by a half-step over a background C note, is not sufficient to sustain a claim for copyright infringement. We affirm the district court’s grant of summary judgment on the ground that Beastie Boys’ use of the composition was de minimis and therefore not actionable.
AFFIRMED.
. In relevant part, the license reads as follows:
1) [Newton] herewith grants, transfers and assigns to ECM without limitations and restrictions whatsoever the exclusive rights to record his performances and to exploit these recordings in perpetuity throughout the world in any manner whatsoever.
3) The grant of rights according to section 1) especially, includes the rights to manufacture in quantitiy [sic], to distribute, to license to others, as well as to perform the recordings in public and to utilize it in radio, TV, or in other ways without any restrictions.
. In relevant part, the license reads as follows:
[ECM Records], as owner of the applicable sound recording rights, including but not limited to recording, reproduction, synchronization and performing rights, grants to Beastie Boys, its licensees, assigns, employees and agents (the "Licensed Parties”), the irrevocable non-exclusive license and right to copy portions (if any) of the sound recording entitled "Choir” performed by James Newton (the “Sample”); to embody the sample in some or all versions of the selection entitled "Pass the Mic” by the Beastie Boys (all versions of "Pass the Mic” which contain the Sample are referred to as the "Selection”); to reproduce, distribute and otherwise exploit the Sample as part of the Selection in all media, whether now known or hereinafter developed, including, without limitation, all record formats throughout the world in perpetuity.