United States Court of Appeals
FOR THE DISTRICT OF COLUMBIA CIRCUIT
Argued October 11, 2000 Decided November 21, 2000
No. 99-1515
Multimax, Inc.,
Petitioner
v.
Federal Aviation Administration,
Respondent
Informatica of America, Inc.,
Intervenor
On Petition for Review of an Order of the
Federal Aviation Administration
Katherine S. Nucci argued the cause for petitioner. With
her on the briefs was Timothy Sullivan.
Daniel L. Kaplan, Attorney, U.S. Department of Justice,
argued the cause for respondent. With him on the brief were
David W. Ogden, Acting Assistant Attorney General, Mark B.
Stern, Attorney, and Wilma A. Lewis, U.S. Attorney. Wil-
liam G. Kanter, Deputy Director, U.S. Department of Jus-
tice, entered an appearance.
Patricia H. Wittie was on the brief for intervenor Informa-
tica of America, Inc.
Before: Edwards, Chief Judge, Rogers, Circuit Judge and
Silberman, Senior Circuit Judge.*
Opinion for the Court filed by Circuit Judge Rogers.
Rogers, Circuit Judge: The Federal Aviation Administra-
tion ("FAA") awarded a contract to Multimax, Inc. ("Multi-
max"), but reversed its decision after an unsuccessful bidder,
Informatica of America, Inc. ("Informatica"), protested the
award to FAA's Office of Dispute Resolution for Acquisition
("ODRA"). ODRA found the contract award to Multimax to
be "without a rational basis and contrary to the [required
procurement] evaluation criteria." The FAA Administrator
issued a final order adopting ODRA's findings and recommen-
dations to terminate Multimax's contract and hire Informatica
to complete the contract. On appeal, Multimax contends that
ODRA applied the wrong standard of review, that its key
findings of fact are unsupported by substantial evidence, and
that its disregard of evidence was arbitrary and capricious,
resulting in an abuse of discretion and a decision contrary to
law. We deny the petition for review.
I.
On May 11, 1999, the FAA announced a solicitation for bids
on a contract to provide information technology support ser-
vices at the William J. Hughes Technical Center (the "Cen-
ter"), a New Jersey facility for research, development, and
testing of aviation programs.1 The solicitation informed pro-
__________
* Senior Judge Silberman was in regular active service at the
time of oral argument.
1 The FAA's Acquisition Management System was developed in
response to Congress' directive "notwithstanding the provisions of
Federal acquisition law," to provide for more timely and cost-
effective acquisitions of equipment and materials. 49 U.S.C.
s 40110(d) (West, WESTLAW through P.L. 106-274, approved
Sept. 22, 2000). ODRA is a review body that was created pursuant
spective bidders that their proposals would be subjected to a
"best value" evaluation-a type of bidding process in which
"combined technical criteria are more important than price."
Thus, the solicitation stated that "the successful offeror may
not necessarily be the [one providing the] lowest priced
offer," but also advised that "[p]rice may become more impor-
tant as the difference between competing technical scores
decrease[s]."
At the Center, a five-member Technical Evaluation Team
(the "TET"), chaired by Dennis Steelman, evaluated the
contract proposals. After the TET eliminated non-
competitive proposals, four offerors remained, including In-
formatica and Multimax. The TET considered and ranked
the proposals according to five factors: (1) Management
Plan/Technical Approach; (2) Key Personnel; (3) Oral Pre-
sentation; (4) Staffing Plan; and (5) Past Performance. The
offerors were also required to submit a price proposal, sepa-
rately from their technical proposal, about which the TET
was not supposed to learn or take into account until its
technical report was completed. By late August 1999, the
TET had reached a consensus that Informatica had provided
the "technically superior offer," and recommended that Infor-
matica be awarded the contract. Informatica had scored
about three and a half points higher than its closest competi-
tor on TET's combined evaluation, and its proposal was the
only one ranked "excellent" (the other three fell into the
"good" range).
The TET reported to the Integrated Products Team (the
"IPT"), which consisted of Dennis Steelman and Anne Marie
Ternay. The IPT was responsible for completing a Technical
Evaluation Report and an Award Recommendation and De-
termination. On Friday, August 27, 1999, Steelman submit-
ted an initial version of the Technical Evaluation Report to
the appropriate FAA contracting official, Michael Ward.
This report recommended awarding the contract to Informati-
ca, based on its clear technical superiority. The same day,
__________
to this mandate, and it handles protests and contract disputes that
arise under the Acquisition Management System. See 14 C.F.R.
part 17 (2000).
Steelman learned price information for the four finalists.
The following Tuesday, August 31, 1999, Ternay notified
Steelman that the Factor 5 scoring had been completed
incorrectly, because Informatica had been judged on the past
performance of its subcontractor.2
The next day, September 1, 1999, the TET was reconvened,
and its members agreed that a Factor 5 scoring error had
been made. Informatica was given the opportunity to submit
additional past performance references. However, the TET
found these references lacking, and Informatica's score on
Factor Five was reduced considerably, from average to poor.
After the Factor 5 rescoring, on September 3, 1999, the TET
characterized Informatica as the "marginally technically supe-
rior offeror." Informatica's edge over its closest competitor
had dropped from three and a half to two points, although its
proposal was still the only one that had won an "excellent"
rating.
However, the revised Technical Evaluation Report complet-
ed by the IPT after the Factor 5 rescoring did not reflect the
TET's consensus that Informatica still possessed a measura-
ble and meaningful technical edge over its competitors. In-
stead, this report stated that "the overall technical ratings of
each proposal are too close to identify the superior offeror,
that each is capable of providing the services called for ...
and for the purposes of this technical evaluation each is the
equal of the other." The final Award Recommendation and
Determination, prepared by Steelman, Ternay, and Ward,
awarded the contract to Multimax. It stated that "there is
insufficient demonstrated technical superiority on the part of
Informatica to justify the additional expense of awarding the
IT contract to that offeror. Over the life of the contract,
Informatica would cost almost a million dollars more than
Multimax. [$23,926,570.40 for [Informatica]; $22,960,852.00
__________
2 As noted subsequently by ODRA, potential offerors and con-
tracting officials at the Center demonstrated some confusion about
whether Factor 5 was confined to evaluation of performance as a
general contractor only.
for Multimax....]" A contract with Multimax was executed
on September 15, 1999.
Informatica filed a protest with ODRA on September 28,
1999, charging that the Center had departed from the evalua-
tion criteria set forth in the Screening Information Request,
and in subsequent materials stating that its proposals would
have "looked very different" if it had understood price would
be given a central role in the selection decision. Multimax
intervened, and after receiving the parties' comments and
responses, ODRA issued its findings and recommendations.
ODRA's report suggested that the IPT allowed concerns
about price to corrupt the evaluation process. ODRA deter-
mined that "the Center improperly 'departed' from the Solici-
tation's evaluation criteria, abandoning the 'best value'
scheme and effectively making an award to the lowest
price/technically acceptable offeror." Additionally, the ODRA
report stated,
without a rational basis, [Steelman] re-worded the [TET]
report, systematically eradicating the previous conclusion
that [Informatica's] proposal was technically superior to
that of Multimax. The ODRA concludes that Mr. Steel-
man's actions, which were taken 'with the result [of
awarding the contract to Multimax] in mind,' leveled the
technical field completely (at least on paper), allowing
low price to determine the award decision.
ODRA bolstered its conclusions by referring to an email
message that was sent from Ternay to Steelman on Septem-
ber 8, 1999, after the Factor 5 rescoring that narrowed
Informatica's edge over its competitors. This message in-
cluded a draft award recommendation that stated, in part,
"given the solicitation's emphasis on technical superiority over
price, the qualitative differences between the two companies
fully justifies [sic] paying a 4% premium for Informatica over
Multimax." Based on this email message, ODRA drew the
inference that on September 8 Ternay believed that even
though Informatica's margin of technical superiority over its
competitors had shrunk, Informatica still provided the best
value. However, draft documents that Steelman transmitted
to Ternay, Ward, and other officials at the Center on Septem-
ber 8 characterized the offerors as equally capable and rec-
ommended awarding the contract to Multimax. ODRA inter-
preted the events of September 8 as evidence of a dramatic
difference in viewpoint between Steelman and Ternay on that
date. Thus, ODRA considered Steelman's drafts expressing
a preference for Multimax to be a "total about-face" from the
judgment of Ternay that was unduly influenced by price
information.
In view of its findings, ODRA recommended that the
contract with Multimax be terminated, and remaining parts of
the contract be awarded to Informatica. ODRA's report
stated that "it is clear that [Informatica] should have been
awarded the contract, had the Solicitation's evaluation criteria
been followed, and there is nothing that would render imprac-
ticable an [Informatica] takeover at this stage." The FAA
Administrator adopted ODRA's findings and recommenda-
tions, and Multimax challenges the Administrator's order,
requesting that it be vacated with instructions to terminate
the contract with Informatica and to execute a new contract
with Multimax.
II.
On appeal, Multimax challenges the FAA's Order in three
respects. First, Multimax contends that ODRA impermissi-
bly substituted its judgment for that of the Center's person-
nel by relying on inferences from an incomplete review of the
evolving evaluation and source selection process, rather than
considering the reasonableness of the Center's final evalua-
tion and award decisions. Second, Multimax contends that
ODRA erred as a matter of law in concluding that the
Center's award decision was contrary to the "best value"
criteria based on an inference drawn from the events of one
day, September 8, 1999. Third, Multimax contends that
ODRA's key findings are unsupported by substantial evi-
dence. Multimax asserts that ODRA ignored Steelman's
sworn testimony and documentary evidence available in dis-
covery materials provided to ODRA to which that testimony
referred, namely that the so-called critical "Price/Technical
Trade-off" section in the September 8 version of the award
recommendation document was created before the Factor 5
rescoring.
Our review is confined to determining whether the FAA's
order adopting the ODRA's findings and recommendations is
arbitrary or capricious or contrary to law. See 5 U.S.C.
s 706(2)(A). Thus, as the court recently stated in J.A. Jones
Management Services v. FAA, 225 F.3d 761 (D.C. Cir. 2000),
"[u]nder this standard, [the court] 'may reverse only if the
agency's decision is not supported by substantial evidence, or
the agency has made a clear error in judgment.' " Jones, 225
F.3d at 764 (quoting Kisser v. Cisneros, 14 F.3d 615, 619
(D.C. Cir. 1994)); see also 49 U.S.C.A. s 46110(c) (West
1997). The court's scrutiny is highly deferential because the
court is reviewing an agency procurement decision that impli-
cates the agency's technical expertise. "Where a procure-
ment decision requires an agency to assess an offeror's
qualifications to perform a contract, our review is 'especially
deferential.' See Iceland S.S. Co., Ltd.-Eimskip v. United
States Dept. of the Army, 201 F.3d 451, 461 (D.C. Cir. 2000).
[The court is] particularly reluctant to second-guess agency
decisionmaking on these " 'delicate questions.' " Elcon En-
ters., Inc. v. Washington Metro. Area Transit Auth., 977 F.2d
1472, 1479 (D.C. Cir. 1992) (quoting Delta Data Sys. Corp. v.
Webster, 744 F.2d 197, 203 (D.C. Cir. 1984))." Jones, 225 F.3d
at 765.
Thus, Multimax's contention that ODRA applied the wrong
standard of review is misplaced. To the extent that ODRA
was required to apply an arbitrary and capricious standard of
review, ODRA met this requirement. Because ODRA deter-
mined that the IPT had impermissibly deviated from a "best
value" evaluation scheme, it was not unreasonable for ODRA
to recommend that Informatica's protest be sustained. Given
our highly deferential scrutiny, we conclude, in the absence of
evidence that ODRA's decision process "involved a clear and
prejudicial violation of applicable statutes or regulations,"
that ODRA's findings and recommendations are consistent
with arbitrary and capricious review. Elcon Enters., 977
F.2d at 1478 (quoting Kentron Hawaii, Ltd. v. Warner, 480
F.2d 1166, 1169 (D.C. Cir. 1973) (internal quotation marks
omitted)); see also Kisser, 14 F.3d at 618.
Similarly, Multimax fails to demonstrate that ODRA erred
by substituting its technical judgment for the Center's assess-
ment of price and technical tradeoffs, instead of simply check-
ing to see that the Center's final procurement decision was
rational. ODRA's report focused on the integrity of the
procurement process, and correctly scrutinized the actions of
the Center's officials to determine whether they adhered to a
"best value" evaluation. Furthermore, the regulations that
govern ODRA afford it broad discretion to choose an appro-
priate remedy for a successful protest. See 14 C.F.R. s 17.21
(2000).
Multimax's contention that ODRA's findings are not sup-
ported by substantial evidence also fails. Substantial evi-
dence is defined as "more than a 'scintilla,' but less than a
preponderance of the evidence." Evans Fin. Corp. v. Di-
rector, Office of Workers Compensation Programs, 161 F.3d
30, 34 (D.C. Cir. 1998) (citations and internal quotation marks
omitted). Again, Jones provides useful guidance. "[T]he
question [the court] face[s] is 'not whether [petitioner's] view
of the facts supports its version of what happened, but rather
whether the [agency's] interpretation of the facts is reason-
ably defensible.' Harter Tomato Prods. Co. v. NLRB, 133
F.3d 934, 938 (D.C. Cir. 1998) (internal quotation marks
omitted)." Jones, 225 F.3d at 765.
Multimax relies heavily on a document that is not in the
administrative record to dispute ODRA's conclusions about
the email messages that Ternay and Steelman sent on Sep-
tember 8, 1999. Multimax attempts to call our attention to
this new evidence to prop up its contention that ODRA
mistakenly inferred that on this date disagreement about the
merits of the offerors' proposals existed between Ternay and
Steelman, and mistakenly concluded that Steelman's Septem-
ber 8 drafts should be characterized as a dramatic "about-
face." It would, however, be fundamentally inappropriate for
the court to consider this new evidence. Although this evi-
dence was made available to Multimax during discovery, it
was not made part of the administrative record, and hence
ODRA had no opportunity to rule on it. Multimax was a
party to the ODRA adjudication, received during discovery
the document that it now uses to dispute ODRA's findings,
and is unable to provide any excuse for its failure to bring the
document to ODRA's attention. "The burden of uncovering
and pointing to the facts relevant to the case before the
agency [belongs to] the parties most concerned in the matter
... Our role is to review the agency's handling of the
objections put before it, not to provide a forum for new
arguments based upon different facts that the petitioner could
have but did not bring out below." Sprint Communications
Co., L.P. v. FCC, 76 F.3d 1221, 1227-28 (D.C. Cir. 1996).
In view of the record before it, ODRA's inference that the
language in Ternay's September 8 email message supported
the conclusion that the Technical Evaluation Report departed
from the principles of "best value" proposal evaluation was
reasonable. Furthermore, even if that particular inference
about the events of September 8 could be considered dubious,
ODRA's decision remains supported by substantial evidence.
Even if there was no disagreement between Ternay and
Steelman on September 8, there is still evidence to support
the conclusion that the IPT deviated from the principles of
"best value" assessment. Contrary to Multimax's contention,
ODRA's findings are not solely based on its interpretation of
the email messages sent by the IPT on September 8. Rath-
er, the bulk of ODRA's findings and the core elements of its
recommendations are supported by at least three other con-
siderations.
First, ODRA noted the dichotomy between the consensus
the TET reached, that Informatica's proposal was measurably
superior to the other offerors' proposals, and the conclusion
the IPT presented in the final Technical Evaluation Report,
that each offeror was equally "capable." The use of the term
"capable" is strongly indicative of a "lowest priced/technically
acceptable" evaluation rather than a "best value" analysis.
Second, ODRA pointed to Steelman's admission that he had
drafted the final TET report, which was supposed to present
an objective perspective on the technical merits of the propos-
als, with the particular result of awarding the contract to
Multimax in mind. Third, ODRA was influenced by the way
that Steelman revised the Technical Evaluation Report and
the Award Recommendation and Determination after he
learned about the prices of the proposals, making Informati-
ca's strengths seem less significant and making Multimax's
weaknesses appear less problematic. These three factors
serve as substantial evidence to support ODRA's conclusion
that the IPT abandoned the "best value" analysis to which it
was required to adhere. Thus, any mistaken inference that
ODRA may have made does not require reversal. See Jones,
225 F.3d at 764, citing 5 U.S.C. s 706.
Accordingly, we deny the petition for review.