Reproductive Viability Analysis (RVA) as a new tool for ex situ population management - Squarespace

Page created by Joseph Harmon
 
CONTINUE READING
Received: 4 July 2018      |   Revised: 14 December 2018   |   Accepted: 21 December 2018
DOI: 10.1002/zoo.21477

RESEARCH ARTICLE

Reproductive Viability Analysis (RVA) as a new tool for ex
situ population management

Karen Bauman1                         |      John Sahrmann2 | Ashley Franklin2                                    |   Cheryl Asa2 |
Mary Agnew2 | Kathy Traylor-Holzer3                                               |   David Powell1

1 Saint   Louis Zoo, Saint Louis, Missouri
2 AZA  Reproductive Management Center,
                                                     Many animal populations managed by the Association of Zoos and Aquariums’ (AZA)
Saint Louis Zoo, Saint Louis, Missouri               Species Survival Plans® (SSPs) have low rates of reproductive success. It is critical that
3 IUCN SSC Conservation Planning Specialist          individuals recommended to breed are successful to achieve genetic and demographic
Group, Apple Valley, Minnesota
                                                     goals set by the SSP. Identifying factors that impact reproductive success can inform
Correspondence
                                                     managers on best practices and improve demographic predictions. A Reproductive
Karen Bauman, Saint Louis Zoo, 1
Government Drive, Saint Louis, MO 63110.             Viability Analysis (RVA) utilizes data gathered from Breeding and Transfer Plans,
Email: kbauman@stlzoo.org
                                                     studbooks, and SSP documents, and through modeling identifies factors associated
                                                     with reproductive success in a given species. Here, we describe the RVA process,
                                                     including different statistical models with the highest accuracy for predicting
                                                     reproductive success in fennec foxes (Vulpes zerda) and Mexican wolves (Canis lupus
                                                     baileyi). Results from the RVA provide knowledge that can be used to make evidence-
                                                     based decisions about pairing and breeding strategies as well as improving
                                                     reproductive success and population sustainability.

                                                     KEYWORDS
                                                     ex situ, reproductive success, sustainability

1 | INTRODUCTION                                                                       Mexican grey wolves Canis lupus baileyi, a species extinct in the wild,
                                                                                       into Arizona and New Mexico in 1998 (USFWS, 2017). There are now
Cooperative breeding and management programs in professionally                         more than 500 SSPs and similar programs in other regional zoo and
managed zoos and aquariums in the United States, administered by the                   aquarium associations.
Association of Zoos and Aquariums (AZA), have been organized since                          However, studies by several authors have demonstrated that not
the 1980's (Ballou et al., 2010, and see Powell, Dorsey, & Faust, this                 all managed programs are meeting their target genetic and demo-
issue). Each of these programs, called Species Survival Plans® [SSP],                  graphic goals and are not sustainable (Lees & Wilcken, 2009; Leus et al.,
focuses on a single species, with a studbook as its foundation; the                    2011; Long, Dorsey, & Boyle, 2011; and see Che-Castro et al., this
studbook is a computerized genealogy for every individual in the SSP                   issue). The historic separation between the ex situ and in situ
population. All SSPs were originally designed to be insurance or ‘ark’                 communities is now gradually being replaced by a mutual respect for
populations, which were demographically and genetically sustainable                    the roles each plays in species recovery and conservation, allowing
to maintain 90% of the gene diversity from the founding population for                 efforts in both realms to be integrated (Conde, Flesness, Colchero,
200 years [later revised to 100 years] (Ballou et al., 2010; Soule, Gilpin,            Jones, & Scheuerlein, 2011; Conde et al., 2015; Maunder & Byers,
Conway, & Foose, 1986; and references therein). Cooperative                            2005; McGowan, Traylor-Holzer, & Leus, 2016; Pritchard, Fa, Oldfield,
breeding programs have directly aided in the recovery of some                          & Harrop, 2011). The “One Plan Approach” promotes this collaborative
species (Conde et al., 2013; Hoffmann et al., 2010), and have served as                process to develop a single integrated species conservation plan
a source of animals for release, for example, the reintroduction of                    (Byers, Lees, Wilcken, & Schwitzer, 2013; Traylor-Holzer, Leus, &

Zoo Biology. 2019;38:55–66.                                    wileyonlinelibrary.com/journal/zoo                           © 2019 Wiley Periodicals, Inc.   |   55
56   |                                                                                                                                       BAUMAN    ET AL.

Byers, 2018). Moreover, intensive species prioritization tools have            tool that analyzes the inherent biological and reproductive character-
been created, for example, the IUCN SSC Conservation Planning                  istics of individual animals (e.g., age, parity, rearing type) and of
Specialist Group's new Integrated Collection Assessment and Planning           breeding pairs (e.g., experience as a pair, age difference) that correlate
(CPSG ICAP) process that can be used to guide ex situ global or regional       with successful reproduction, that is, the “reproductive viability” of a
collection planning (Traylor-Holzer et al., this issue). Yet, if the ex situ   given species. The RVA is similar to a PVA in that it utilizes a variety of
community is to be increasingly relied upon for conservation roles, we         data inputs, is data intensive, and through modeling determines what
must assure that cooperative breeding programs are efficient and we            factors impact outcomes (in this case reproductive success), and thus
are managing robust, viable populations.                                       are key to population persistence. Unlike a PVA, though, the RVA
         SSP sustainability has been addressed in several ways. AZA has        process generally ignores environmental and management factors and
partnered with the Lincoln Park Zoo and the AZA Population                     does not make projections about the future status of populations.
Management Center (PMC) to conduct population viability analyses                   Here we describe the RVA process and present results from the
(PVAs) on many SSPs (Che-Castaldo et al., this issue). A web-based             first two RVAs, conducted for Mexican wolves (Canis lupus baileyi) and
program called PMCTrack, was developed as a tool to improve                    fennec foxes (Vulpes zerda). These species were selected because they
population sustainability (Faust et al., 2011). PMCTrack maintains             had good quality source data readily available, the reproductive
studbook data, as well as the SSP Breeding and Transfer Plans (BTP)            physiology of both species has been well studied (Asa & Valdespino,
recommendations, and through a user interface tracks breeding and              1998; Valdespino, Asa, & Bauman, 2002), and canids were identified as
transfer recommendation fulfillment (or lack thereof) to identify              a taxon of concern (Agnew & Asa, 2014; Asa et al., 2014). The AZA
obstacles so they can be addressed. A recent analysis of SSP breeding          Fennec Fox SSP program, like many small canid programs, has
recommendations found that on average only 20% of breeding                     struggled to maintain a sustainable population due to inconsistent
recommendations were being fulfilled (Faust et al., this issue).               reproductive success (Bauman, Mekarska, Grisham, & Lynch, 2010). In
Unfulfilled recommendations were the result of many factors, some              contrast, the AZA Mexican Wolf SSP has had relatively reliable
being logistical or related to institutional compliance (e.g., institutional   reproduction in general but higher inbreeding than most populations
failure to transfer, weather preventing transfer, failure to put animals       since there were only seven founders.
together), while others were likely due to biological factors such as              Several different modeling approaches are used in the RVA
incompatibility (see Martin-Wintle et al., this issue) or fertility (animals   process (see section 2) to determine which has the best power at
were put together, but did not produce offspring). AZA addressed the           predicting reproductive success. For these species, we predicted that
issues relating to logistics by re-structuring programs, providing             an experience-based model, where the variables to be tested against
participation incentives, and changing management practices. How-              reproductive success are identified in advance by species coordinators
ever, poor or inconsistent reproduction was not being systematically           with extensive knowledge of the species and for which there is a robust
addressed across SSP programs. Therefore, the AZA expanded the                 scientific literature, would perform best.
purview of the AZA Wildlife Contraception Center (WCC, now called
the AZA Reproductive Management Center or RMC) to identify taxa
                                                                               2 | METHO DS
with high rates of reproductive failure, and suggest approaches to
mitigate problems. The initial focus was largely on carnivores and
                                                                               2.1 | Data sources
ungulates, as studies with elephants, rhinos, wildebeest, felids, and
canids had shown that a common cause of reproductive failure was               Consideration of all pairs, successful or not, is vital to the RVA process for
uterine pathology associated with delayed first reproduction or                proper analysis of factors that promote or hamper reproductive
prolonged periods without production of young, which are manage-               success of a species. We used two primary data sources: the BTPs,
ment strategies often used when SSPs are at capacity—a phenomenon              and the studbooks with the histories of each individual, as well as
characterized as “use it or lose it” (Asa et al., 2014; Penfold, Powell,       supplementary information from the documents maintained by the SSP
Traylor-Holzer, & Asa, 2014; and references therein). However,                 Coordinators and in other AZA databases. BTPs are individual-based
uterine pathology does not explain reproductive failure in all species.        recommendations (breeding/non-breeding, transfer/do not transfer)
Many SSPs have low reproductive efficiency—the number of                       generated each time (every 1–3 years) a SSP meets with the PMC (or
recommended breeding pairs far exceeds the number of offspring                 other population advisor) to review the demographic and genetic status
born. Analyses conducted of the lion [Panthera leo] (Daigle et al., 2015)      of the population as it relates to the long-term goals for the SSP. These
and tiger (Panthera tigris) (Saunders, Harris, Traylor-Holzer, & Good-         recommendations are based upon an analysis of studbook data, along
rowe-Beck, 2014) SSPs provided a valuable starting point for our goal          with animal (e.g., health, behavior, history, and age) and institutional
to establish a method that could be used efficiently in a wide diversity       information are then considered for all animals in the population.
of species to identify the factors that drive reproductive success                 All of the source data were directly entered by hand into Excel,
(Agnew & Asa, 2014). We developed the Reproductive Viability                   however, subsequent to the completion of these initial two RVAs, a
Analysis (RVA) process to analyze past breeding recommendations and            method for populating the RVA data fields directly from PMCTrack
produce timely results from which evidenced-based management                   into an Access database was developed by the RMC which should
decisions could be made to improve SSP sustainability. The RVA is a            make future RVAs more efficient.
BAUMAN    ET AL.
                                                                                                                                                            |   57

    A list of the RVA variables with a description along with their              had ever served or were currently serving as an animal ambassador.
source(s) is provided in Table 1. The RVA process relies on a core set of        This is important for this RVA, as approximately one third of the
variables, but is designed to be flexible, so variables may be added             animals in this SSP are used for education programs.
depending on the species and its biology. For example, fennec foxes can
have multiple litters per year so fields were added to include data relating
                                                                                 2.3 | Definition of reproductive success
to any second or third litters. Additionally, species-specific data fields can
also be included to address variables that might be important for breeding       For the RVA, we assigned success (or failure) for each pair based on
success in a given species as suggested by the scientific literature (e.g.,      whether offspring were born (including stillborn offspring) within the
lineage effects in Mexican wolves, see Asa et al., 2007) or management           active period of the BTP. We defined this active period as starting on
experience (e.g., ambassador animal history in fennec foxes). For some           the date the BTP was finalized until the date the next Plan was
species, parameters such as social groupings might be relevant.                  finalized, for example, if a BTP was finalized in July of 2001 with next
                                                                                 plan in 2002, the active period would be July 2001 until July 2002. We
                                                                                 focused on the production of, rather than survival of, offspring because
2.2 | Data collection
                                                                                 birth is the primary indicator that reproduction has been successful.
Data from all available BTPs for each species were used to identify all
recommended breeding pairs. Each pair was assigned a pair type: a
                                                                                 2.4 | Statistical analyses
“new” pair was two individuals recommended to breed together for the
first time; a “carryover” was a pair that had been previously together           Data for any pair that was not given the opportunity to breed were
but had never had offspring together; or an “experienced” pair was one           removed from the primary dataset and analyzed separately using
that had offspring together previously. When one individual had a                descriptive statistics as these data provide important information on
recommendation to breed with more than one partner, each possible                causes of logistical failures. They also can be informative in predicting
pairing was entered as a separate recommendation.                                overall likelihood of breeding recommendation success (e.g., probabil-
    Studbook data were used to provide individual-specific data for              ity of success if transfer is required, see Faust, this issue) and are
each animal in the pair at the time of the breeding recommendation, as           valuable for calculating the number of pairs needed to meet population
well as providing information on any offspring the recommended pair              demographic goals.
produced. Both studbook software programs (PopLink (Faust,                           Descriptive statistics were run on all variables in Table 1 for all
Bergstrom,     Thompson,      &   Bier,   2012)    and    SPARKS      [www.      pairs given the opportunity to breed (primary dataset). Variables that
Species360.org]) have reproductive reports that provide information              had insufficient sample sizes (e.g., prior use of contraception) or had
on parity, details on offspring (birth date, number of offspring born,           low variability (e.g., only one Mexican wolf was hand-reared) were not
other parent of offspring, etc.) and number of years since the last litter.      included in additional analyses. All additional analyses were conducted
Studbook data were also used to identify any offspring produced by               within R version 3.2.1 (R Core Team, 2015) on the subset of variables.
any pairs who had not been recommended to breed. Because staff                   For fennec foxes these included female age, male age, age difference,
experience and management protocols have been associated with                    rearing type, pair parity, pair type, litter last 5 years, litter last 10 years,
reproductive success in some species (Saunders et al., 2014), for each           both at breeding location, and year; whereas for Mexican wolves these
pair we recorded whether the institution receiving the breeding                  were female age, male age, age difference, female inbreeding, male
recommendation had successful reproduction in the previous 5-year                inbreeding, pair parity, pair type, litter last 5 years, litter last 10 years,
period and 10-year period for that species. The studbook was also used           both at breeding location, and year. Success of a pair was treated as a
to provide information on “specialty” fields such as rearing type for            binary response variable. A unique identifier was assigned to each pair
fennec foxes, and lineage for Mexican wolves.                                    that served as a random effect in each model to account for
    Although not available for every SSP, whenever possible,                     dependencies in the data resulting from some pairs receiving more
information provided by the SSP Coordinator on any additional pairs              than one recommendation. The year in which the recommendation
that might have been recommended to breed between published plans                was made was included to test for any change in the rate of success
(interim recommendations) as well as relevant notes including whether            over time independent of the other variables under consideration, for
attempts were made to fulfill recommendations (or not), whether the              example, if husbandry improved.
recommended pair had an opportunity to breed (i.e., were housed                      Four different modeling approaches were utilized in the analysis.
together for a sufficient period of time), and mating behaviors or               The first approach, hereafter referred to as the experience-based
copulation observed are included in the RVA dataset. The majority of             approach, began with the design of eight models consisting of different
these data existed for Mexican wolves, including mate access date                numbers and combinations of the explanatory variables. Variables
information gathered as part of an annual SSP report for US Fish and             were chosen based on results from descriptive statistics of the RVA
Wildlife Service. For fennec foxes, interim recommendations and notes            dataset, consensus from SSP Coordinators regarding what variables
about attempts to fulfill recommendations were available, and the                they believed were relevant to success in the species, and a review of
Coordinator gathered data on opportunity to breed and used                       the literature (Burnham, Anderson, & Huyvaert, 2011; Dochtermann &
institutional records to determine whether the individuals in the pair           Jenkins, 2011; Saunders et al., 2014). Individual models were
58    |                                                                                                                                           BAUMAN    ET AL.

TABLE 1           Description of variables used in the RVA with definition and data source information
    Variable name           Definition                                                                     Data source
    Attributes of pairs
      RecAttempta           “Yes” or “No” depending on if there was an attempt to follow the               SSP coordinator and/or Institutional
                              breeding recommendation (animals transferred/animals put together/             Representative
                              etc.).
      Successa              “Yes” if the pair successfully produced offspring (live or stillborn) during   Studbook
                              the B&T Plan period. “No” if the pair was unsuccessful.
      BTYeara               Master Plan/Breeding & Transfer Plan the pair is listed in (year only); or     Breeding & Transfer Plan; SSP coordinator for
                             year of interim recommendation                                                  Interim Recommendations
      Locationa             Institution where the pair was recommended to breed in Master Plan/            Breeding & Transfer Plan; SSP coordinator for
                              Breeding & Transfer Plan                                                       Interim Recommendations
      AtLocationa           “Yes” if both the male and female in the pair are at the same institution      Breeding & Transfer Plan; Studbook
                              already prior to the date the B&T plan was published. “No” if one or
                              both individuals has to be transferred to a new institution to fulfill the
                              breeding recommendation
      IntSuccess5           Has the institution successfully bred this species in the five years prior     Studbook
                             to the published date of the B&T plan? “Yes” or “No”
      IntSuccess10          Has the institution successfully bred this species in the ten years prior to   Studbook
                             the published date of the B&T plan? “Yes” or “No”
      PairType              “New” if pair has the opportunity to breed together for the first time;        Breeding & Transfer Plans; Studbook (for non-
                              “experienced” if the pair had a previous opportunity together and              recommended breeding); SSP coordinator for
                              they successfully produced offspring; or “carryover” if the pair had a         interim pairs
                              previous opportunity together but has never produced offspring.
      PairParity            “Parous” if both individuals are parous; “Nulliparous” if both individuals     Calculated field; requires male and female parity
                              are nulliparous; “Mixed” if parous individual paired with nulliparous          variables
                              individual
      PairRearing           “Parent” if both individuals were parent reared; “Hand” if both                Calculated field; requires male and female rearing
                              individuals were hand reared; “Mixed” if a parent reared individual is         type variables
                              paired with a hand reared individual
      AgeDiff               Difference in age (in years) between the male and female.                      Calculated field; requires male and female age
                                                                                                             variables
    Attributes of individuals
      MSBa                  Male's Studbook Number                                                         Breeding & Transfer Plans; Studbook (for non-
                                                                                                             recommended breeding); SSP coordinator for
                                                                                                             interim pairs
      FSBa                  Female's Studbook Number                                                       Breeding & Transfer Plans; Studbook (for non-
                                                                                                             recommended breeding); SSP coordinator for
                                                                                                             interim pairs
      Agea                  Individual's age at the time the breeding recommendation was made              Breeding & Transfer Plan
      Parity                Individual's parity at the time the breeding recommendation was made           Studbook
      RearingType           “Parent” if individual was parent reared; “Hand” if individual was hand        Studbook
                              reared
      Inbreeding            Inbreeding coefficient of the individual                                       Calculated in PMx or other software from
                                                                                                             studbook data
      Contraception         “Yes” if the individual has ever previously been contracepted; else “No”       RMC's contraception database
      Lineage               Can be used to identify genetic lineages (e.g., Mexican wolf)                  Studbook
      Role                  This variable can be used to identify animals with different roles, such as    Studbook
                              education or ambassador animals.
      Origin                “Captive” born or “Wild” born                                                  Studbook
      NumYrLastLitter       Number of years since the female last gave birth                               Calculated from studbook
a
Indicates data that in the future will be directly imported from PMCTrack for RVAs.
BAUMAN   ET AL.
                                                                                                                                                     |   59

compared using Akaike's information criterion with a correction for        BTPs representing a 10-year population management history (2004 to
small sample sizes (AICc—the best model has the smallest value), and       2014) that included 162 breeding recommendations. Nine records
model averaging was used to obtain a single, final model (Burnham          were excluded from the fennec fox dataset due to missing data and 22
et al., 2011; Symonds & Moussalli, 2011).                                  (14.2% of all recommended pairs) records were excluded because
    The second approach considered models containing all subsets of        foxes were not given the opportunity to breed. Records were excluded
the ten or eleven explanatory variables used for fennec fox and Mexican    from the Mexican wolf dataset due to missing data (N = 5) and an
wolf, respectively. Because of the limited sample size, no interaction     additional 223 records (31.7% of all recommended pairs) were
terms were included, resulting in 1,024 unique models for fennec fox       excluded because the recommended pair was not given the
and 2,048 unique models for Mexican wolves. Models were assessed           opportunity to breed due to logistical reasons. Logistical reasons
with AICc, and model averaging was used to generate a single model.        resulting in the recommendations not being attempted were similar
    The third approach made use of the least absolute shrinkage and        between the two species; these included shipment problems (import
selection operator (LASSO) regression technique to fit a single model      canceled, facility could not get animal transferred due to weather, etc.),
including all explanatory variables. LASSO regression optimizes the fit    or a facility refused to or could not comply with recommendations.
to the data while constraining its complexity; therefore the regression           Of the remaining 131 and 482 breeding recommendations for
coefficients for some of the explanatory variables are forced to           fennec fox and Mexican wolves respectively, only 24.4% (32 of 131) of
become zero, resulting in simpler models compared to traditional           the fennec fox pairs and 45.9% (221 of 482) Mexican wolf pairs
regression techniques, decreasing the likelihood of overfitting and        produced at least one litter within the active period. Descriptive
improving the accuracy of predictions made on new data (James,             statistics for the pair-related variables related to reproductive success
Witten, Hastie, & Tibshirani, 2014).                                       are presented in Table 2 (fennec fox) and Table 3 (Mexican wolf),
    The fourth approach used was the creation of a conditional
random forest (CRF) model (Strobl, Boulesteix, Kneib, Augustin, &
                                                                           TABLE 2 Descriptive statistics for pair-related variables’ impact on
Zeileis, 2008; Strobl, Malley, & Tutz, 2009) to generate the predictions   reproductive success in fennec fox pairs given the opportunity to
for the probability of reproductive success. The CRF model constructs      breed
a “forest” of conditional inference trees, which are grown based on                                                     Fennec      Fennec fox %
bootstrapping samples with only a subset of variables available for            Pair condition                           fox, N      successful (N)
splitting each node. For generating predictions, weighted means of all         Pairs with opportunity to breed          131         24.4% (32)
the observed responses (or decisions) from all the inference trees             Pair type
created are used. While conditional inference trees utilize significance         Sexually experienced pairs             27          59.2% (16)
tests for determining the splitting variables and split points for the
                                                                                 Carryover pairs                        32          12.0% (4)
creation of nodes within the decision trees, there are no classical
                                                                                 New pairs                              72          16.6% (12)
significances for the explanatory variables. Rather, variable importance
                                                                               Pair previous success
measures are assigned (Strobl et al., 2008; Strobl et al., 2009).
    The four approaches were compared by using the resulting models              Both in pair were previously           31          58.0% (18)
                                                                                   successful (parous)
to predict the probability of success for selected recent BTP for each
                                                                                 Both in pair were previously           62          24.0% (12)
species with known outcomes, which had not been used to fit the
                                                                                   unsuccessful (nulliparous)
models (Fennec foxes 2014 and 2015 BTPs for 37 pairs; Mexican
                                                                                 One in pair was previously             38          7.8% (3)
wolves 2016 BTP for 26 pairs). Performance was measured using the
                                                                                  successful and other was not
area under the receiver operating characteristic (ROC) curve (AUC).
                                                                               Pair rearing type
AUC has been used in a variety of settings to assess the accuracy of
                                                                                 Both in pair were hand-reared          22          45.5% (10)
models over a range of thresholds for classifying a binary outcome
(Jiménez-Valverde, 2012). Values range from 0 to 1, with an AUC of               Both in pair were parent-reared        18          33.0% (6)

0.5 expected as being the same as random and values close to 1                   Mixed rearing type pair                91          17.6% (16)
representing high accuracy in predicting realized outcomes.                    Pairs carried over beyond the original recommendation
                                                                                 Pairs carried over for 1 year          21          19.0% (4)
                                                                                 Pairs carried over for 2 year          4           0.0% (0)
3 | RE SULTS                                                                     Pair carried over for 3 year           1           0.0% (0)
                                                                               Number of litters born within the time period for successful pairsa
The AZA Mexican Wolf SSP has created annual BTPs since 1983, with
                                                                                 Successful pairs that had only 1       32          69.0% (22)
710 breeding recommendations made between 1983 and 2015 thus
                                                                                   litter
the Mexican wolf RVA dataset represents 32 years of data. In contrast,
                                                                                 Successful pairs that had 2 litters    32          28.0% (9)
the AZA Fennec Fox SSP BTPs were issued biennially from 2004 until
                                                                                 Successful pairs that had 3 litters    32          3.0% (1)
2010 and yearly thereafter when population instability necessitated
                                                                           a
more frequent planning. Therefore, for the fennec fox, we used eight       Period of the Breeding and Transfer Plan: 1–2 years.
60   |                                                                                                                               BAUMAN    ET AL.

TABLE 3 Descriptive statistics for pair-related variables’ impact on       TABLE 4 Descriptive statistics for individual-related variables’
reproductive success in Mexican wolf pairs given the opportunity to        impact on reproductive success in fennec fox pairs given the
breed                                                                      opportunity to breed
                                      Mexican      Mexican wolf %                                                               % successful
 Pair condition                       wolf, N      successful (N)           Individual foxes                              N     (N)
 Pairs with opportunity to breed      482          45.9% (221)              Individual previous success
 Pair type                                                                    Previously unsuccessful males (any ages)    86    16.3% (14)
     Sexually experienced pairs       140          66.4% (93)                 Previously successful males (any age)       46    39.1% (18)
     Carryover pairs                  97           27.8% (27)                 Previously unsuccessful females (any        85    15.2% (13)
                                                                                age)
     New pairs                        245          41.2% (101)
                                                                              Previously successful females (any age)     47    40.4% (19)
 Pair previous success
                                                                            Age of females given the opportunity to breed
     Both in pair were previously     158          66.5% (105)
       successful (parous)                                                    0 (less than 1 year)                        8     50.0% (4)
     Both in pair were previously     239          29.3% (70)                 1                                           13    38.4% (5)
       unsuccessful (nulliparous)
                                                                              2                                           26    26.9% (7)
     One in pair was previously       85           54.1% (46)
                                                                              3                                           15    46.6% (7)
      successful and other was not
                                                                              4                                           18    27.7% (5)
 Pairs carried over beyond the original recommendation
                                                                              5                                           14    21.4% (3)
     Pairs carried over for 1year     71           33.8% (24)
                                                                              6                                           5     20.0 % (1)
     Pairs carried over for 2 year    21           16.6% (3)
                                                                              7–14                                        32    0.0% (0)
     Pair carried over for 3 year     4            0.0% (0)

whereas individual-related variables are in Tables 4 and 5 for fennec      rearing type, and the age difference of the pair, in various
fox and Mexican wolves respectively. Briefly, results for fennec foxes     combinations. The fennec fox model developed using the LASSO
show that no female over age six has been successful despite a median      regression technique was more restrictive, and only identified pair
life expectancy for this species of 11 years (www.aza.org/species-         type, female age, and male age as being significant predictors of
survival-statistics). Pairs where an experienced (parous) individual was   reproductive success and decreases as female age and male age
paired with an inexperienced (nulliparous) individual were rarely          increase.
successful; similarly pairs with individuals of different rearing types        The logistic equation produced from the LASSO regression is
were not successful. Pairs that were carried over for 1 year did have      presented in Figure 1a. When predictions for the reproductive success
some success; however, pairs carried over for 2 or 3 years did not. For    of pairs were generated by the conditional random forest, the top five
Mexican wolves, carry over pairs were successful in the first and          most important factors for the fennec fox population were pair type,
second years, although the success rate in year 2 was much lower; like     male age, female age, parity of the pair, and the age difference between
the fennec fox, no Mexican wolf carry over pairs were successful in        the male and female (Figure 2a). Consensus among the modeling
year 3. Success decreased markedly in males with inbreeding                methods evaluated illustrates that female age and experience as a pair
coefficients greater than 0.3.                                             are the factors most significantly associated with reproductive success
                                                                           in the AZA Fennec Fox SSP population: the probability of a breeding
                                                                           pair to be successful decreases as female age increases, and increases if
3.1 | Statistical prediction models
                                                                           the pair is “experienced.” Other factors identified among multiple
                                                                           methods included pair parity, male age, and the age difference
3.1.1 | Fennec fox
                                                                           between the male and female.
The models constructed using the experience-based approach for
fennec fox in order of AICc values are presented in Table 6. The
                                                                           3.1.2 | Mexican wolf
model containing female age, parity of the pair, pair type, and the
difference between female and male ages had the lowest AICc. A             For Mexican wolves, the models constructed using the experience-
model containing those same variables, plus whether the female and         based approach in order of AICc values are presented in Table 7. The
male were at the same location at the time the breeding                    model containing female age, male age, parity of the pair, pair type,
recommendation was made, performed almost as well. The null                male inbreeding coefficient, and female inbreeding coefficient had the
model containing no explanatory variables and the full model               lowest AICc and was thus the best model. The null model containing no
containing all explanatory variables performed worst. When looking         explanatory variables performed worst in this analysis. When looking
at all-subsets of the variables, there were three top performing           at all-subsets of the variables, the top performing model included male
models which included female age, parity of the pair, pair type,           age, parity of the pair, male and female inbreeding coefficients, the age
BAUMAN    ET AL.
                                                                                                                                                         |   61

TABLE 5 Descriptive statistics for individual-related variables’                         Figure 1b contains the logistic equation produced from the LASSO
impact on reproductive success in Mexican wolf pairs given the                      regression. When predictions for the reproductive success of pairs
opportunity to breed
                                                                                    were generated by the conditional random forest for the Mexican wolf
 Individual wolves                               N        % successful (N)          population, parity of the pair, male age, male and female inbreeding
 Individual previous success                                                        coefficients, and pair type were the most important factors for
   Previously unsuccessful males (any age)       268      33.3% (89)                predicting reproductive success (Figure 2b). Consensus factors among
   Previously successful males (any age)         214      61.7% (132)               the modeling methods for the Mexican wolf population suggest that
   Previously unsuccessful females (any age)     295      32.9% (97)                male age, pair parity, and male and female inbreeding coefficients are
   Previously successful females (any age)       187      66.3% (124)               the factors most significantly associated with reproductive success:
 Age of females given the opportunity to breed                                      probability of success increases if either the male or female are parous
   0 (less than 1 year)                          2        0.0% (0)                  (but highest if both are parous), and probability of success decreases as
   1                                             37       32.4% (12)                male age increases, and as male and female inbreeding coefficients
   2                                             62       48.4% (30)                increase. Additionally, pair type and prior institutional success within
   3                                             58       48.3% (28)                10 years were identified among multiple modeling methods as
   4                                             56       53.6% (30)                influencing the probability of success for Mexican wolves.
   5                                             55       43.6% (24)
   6                                             48       54.2% (26)                3.2 | Comparison of modeling strategies
   7                                             38       55.6% (21)
                                                                                    Of the four modeling strategies, LASSO regression performed best
   8                                             37       37.8% (14)
                                                                                    according to AUC (Figure 3a) for fennec foxes, but for Mexican
   9                                             39       43.6% (17)
                                                                                    wolves the conditional random forest approach was better than all
   10                                            27       48.1% (13)
                                                                                    other models (Figure 3b). For both species, all models were superior
   11                                            19       26.3% (5)
                                                                                    to random as the AUC was above 0.5 in all cases. Figure 4 shows the
   12                                            4        25.0% (1)
                                                                                    predicted probability of success for each of the 37 and 26 test pairs,
 Male inbreeding coefficients
                                                                                    respectively, for fennec foxes and Mexican wolves generated by
   0                                             88       59.0% (52)
                                                                                    each modeling strategy, overlaid upon the actual outcomes
   0.05–0.099                                    51       49.0% (25)
                                                                                    (success = 1, failure = 0) of those pairings. Predicted probabilities
   0.1–0.124                                     22       59.0% (13)
                                                                                    from the LASSO model fell within a narrower range between 0.1 and
   0.125–0.149                                   108      47.0% (51)
                                                                                    0.5 for fennec fox and between 0.21 and 0.82 for Mexican wolf. By
   0.15–0.199                                    118      45.7% (54)
                                                                                    contrast, the experience-based, all subsets models, and the
   0.2–0.299                                     70       37.1% (26)                conditional random forest generated probabilities as low as near 0
   0.3–0.499                                     33       18.2% (6)                 and as high as 0.92 for fennec and Mexican wolf.
   0.5 and above                                 19       10.5% (2)

                                                                                    4 | DISCUSSION
difference of the pair, and prior success at the institution within the last
10 years. Significant predictors of reproductive success in the Mexican             RVA statistically identifies key pair- and individual-related factors that
wolf LASSO model were parity of the pair, male age, male and female                 have affected reproductive success in a given population. This
inbreeding coefficients, and prior success at the institution.                      information can be used as a tool by program leaders to improve

TABLE 6      Comparison of ΔAICc and weights among models tested for fennec fox as part of the experience-based approach
 Variables in model                                                                                                     ΔAICc               Model weight
 Female age, pair parity, pair type, age difference                                                                     0                   0.41
 Female age, pair parity, pair type, age difference, both at breeding location                                          0.22                0.37
 Female age, pair parity, pair type, age difference, rearing type, male age                                             3.27                0.08
 Female age, pair parity, pair type, age difference, litter last 5 years, litter last 10 years                          3.77                0.06
 Female age, pair parity, pair type, age difference, litter last 5 years, litter last 10 years, rearing type,           4.84                0.04
   both at breeding location
 Female age, pair parity, pair type, age difference, litter last 5 years, litter last 10 years, year                    6.31                0.02
 Null (no explanatory variables)                                                                                        9.78                3E-3
 Female age, pair parity, pair type, age difference, litter last 5 years, litter last 10 years, rearing                 10.20               3E-3
   type, both at breeding location, year, male age
62   |                                                                                                                              BAUMAN    ET AL.

                                (a)

                (b)

FIGURE 1 The logistic equations produced from the LASSO regression, for fennec fox (a) and Mexican wolf (b), where: p(S) is the
probability of success, E = 1 if the pair is experienced, otherwise E = 0, MA is the age of the male, FA is the age of the female, YY = 1 if both
the male and female are parous, otherwise YY = 0, M = 1 if only one individual (the male OR the female) is parous, otherwise M = 0, PS = 1 if
the pair is at an institution that has successfully bred Mexican wolves in the past 10 years, otherwise PS = 0, MF is the inbreeding coefficient
of the male and FF is the inbreeding coefficient of the female

the sustainability of their populations by making better-informed          RVA dataset in the future, more subtle factors may be identified. The
breeding recommendations.                                                  LASSO statistical model clearly performed the best for fennec foxes,
         The AZA Fennec Fox RVA process revealed that female age and       and we believe it is likely to do so for other species with limited
parity are key drivers of reproductive success in this species, with       historical data. Because it limits complexity, LASSO prevents
male age, pair experience, and age difference also being effective         overfitting the data, which is probably why its predictions were
predictors. Unfortunately, the sample size was too small to estimate       better on the new pairs, as well as more moderated (i.e., LASSO gave
all but the strongest effects (female age and parity, in this case);       most new pairs a probability of success in the range 20–50%,
however, if data from the EAZA Fennec Fox ESB were added to the            whereas the other approaches tended to be all or nothing, 0% or
                                                                           100%).
                                                                                In contrast, the data set for the AZA Mexican Wolf SSP was
                                                                           much larger, providing more statistical power to estimate smaller
                                                                           effects, as male age, pair parity, male and female inbreeding
                                                                           coefficients, and pair type were all effective predictors of
                                                                           reproductive success. Additionally, the larger sample size and
                                                                           associated increase in power provides more opportunity to
                                                                           investigate possible interactive effects between factors. The
                                                                           conditional random forest technique was the only predictive model
                                                                           used that considers possible interactions between factors, which
                                                                           may explain why this technique worked best for the Mexican wolf
                                                                           population, as it was able to better fine-tune the predictions. We
                                                                           believe this approach is likely to work well for other species with
                                                                           richer historical data sets.
                                                                                Beyond the statistical modeling in R as part of the RVA process,
                                                                           the data exploration we conducted to populate the R models also
                                                                           revealed some useful information. For example, in 2010, as part of a
                                                                           new breeding strategy, proven-breeder fennec foxes were paired with
                                                                           inexperienced individuals in the hope that the experienced individual
                                                                           would “teach” the inexperienced one. Likewise, some pairs were also
                                                                           purposely selected to be comprised of individuals with different
                                                                           rearing types (hand- and parent-reared), with the hope that the more
                                                                           relaxed hand-reared individual would provide some stability for its
                                                                           mate. However, RVA results suggest that these ideas may have been
                                                                           counter-productive, so these practices were discontinued in 2017. It is
                                                                           difficult to decide how long to leave an unsuccessful pair together, so
FIGURE 2 Variable importance scores for each factor used in the
                                                                           the information that no “carryover” pair has been successful after 2 or
creation of nodes within the conditional inference trees for the
                                                                           3 years, in fennec fox and Mexican wolves, respectively, provides
fennec fox (a) and Mexican wolf (b) random forest models. Factors
with higher importance scores are the variables that are driving the       valuable information. While the finding of female age effects in both
predictions of reproductive success (or failure)                           species was potentially predictable, given the importance of this factor
BAUMAN    ET AL.
                                                                                                                                                           |   63

TABLE 7      Comparison of ΔAICc and weights among models tested for Mexican wolf as part of the experience-based approach
 Variables in model                                                                                                          ΔAICc           Model weight
 Female age, male age, pair parity, pair type, male inbreeding, female inbreeding                                            0               0.77
 Female age, male age, pair parity, pair type, age difference, litter last 5 years, litter last 10 years,                    2.42            0.23
   both at breeding location, year, male inbreeding, female inbreeding
 Female age, male age, pair parity, pair type, litter last 5 years, litter last 10 years                                     16.22           2E-4
 Female age, male age, pair parity, pair type, age difference, litter last 5 years, litter last 10 years,                    17.4            1E-4
   both at breeding location, year
 Female age, male age, pair parity, pair type, litter last 5 years, litter last 10 years, both at breeding location          17.47           1E-4
 Female age, pair parity, pair type, both at breeding location                                                               30.8            2E-7
 Pair parity, pair type, both at breeding location                                                                           40.62           1E-9
 Null (no explanatory variables)                                                                                             65.64           4E-15

in the literature for mammals generally (Cohen, 2004; Lockyear,                     years) was a surprise. This pattern, described by Daigle et al. (2015) in
Waddell, Goodrowe, & MacDonald, 2009; Ricklefs, Scheuerlein, &                      captive lions, was speculated to be related to husbandry, since wild
Cohen, 2003) and for tigers through a similar process (Saunders et al.,             lionesses commonly reproduce until 12 or 13 years of age. Further
2014) confirmation through such a rigorous process for these two                    investigation into both husbandry correlates and possible differences
species provides support that these factors should be weighted highly               in ovulatory patterns by age for fennec foxes is merited. Another
in population planning. The finding that female fennec foxes                        surprising finding was the impact of male age in Mexican wolves, which
reproduced for less than half their lifespan (no reproduction after 6               also needs further investigation. Lastly, it is interesting that, despite
                                                                                    institutional knowledge being important for reproductive success in
                                                                                    tigers and lions (Daigle et al., 2015; Saunders et al., 2014), it was not at
                                                                                    all so for Mexican wolves. This may be because the Mexican Wolf SSP
                                                                                    has emphasized consistent husbandry practices due to the reintroduc-
                                                                                    tion potential and binational nature of that SSP, so institutional
                                                                                    knowledge has not been lost.
                                                                                           We see a role for RVA in any cooperative breeding program
                                                                                    where breeding efficiency, that is, a high proportion of breeding
                                                                                    recommendations result in births, is lacking. Turnover of SSP
                                                                                    coordinators can be high, making it difficult for many program
                                                                                    leaders to have long-term insight into reproductive performance of
                                                                                    the population. With time, program leaders accumulate more
                                                                                    experience dealing with reproductive challenges and may learn
                                                                                    from research in the population they manage. Still, it is challenging
                                                                                    for even an experienced program leader to put together all of the
                                                                                    pieces that impact reproductive success in their population. They
                                                                                    may borrow insights from other species that may apply to their own
                                                                                    program or make common-sense assumptions in the absence of data,
                                                                                    as was done previously in fennecs, about factors that should
                                                                                    promote better breeding success. However, these guesses could be
                                                                                    wrong; results from the RVA provide information for making
                                                                                    evidence-based decisions about pairing and breeding strategies.
                                                                                           Reproductive success should be monitored following changes
                                                                                    implemented after an RVA, especially since this is a new process. The
                                                                                    ability to now connect the RVA data collection process to PMCTrack,
                                                                                    means that over time, RVAs can easily be run periodically to determine
                                                                                    whether the lessons learned previously still apply. In addition,
FIGURE 3 Area under the receiver operating characteristic (ROC)
                                                                                    reproduction management strategies change as SSPs evolve from a
curve (AUC) for four modeling strategies tested on (a) 37 breeding
                                                                                    “growth phase” to a “maintenance phase” at space capacity, which can
pairs from the 2014 and 2015 Fennec Fox Breeding and Transfer
Plans and (b) 26 breeding pairs from the 2016 Mexican Wolf                          alter reproductive success and lead to the need for additional
Breeding and Transfer Plan                                                          information and management considerations.
64   |                                                                                                                               BAUMAN   ET AL.

FIGURE 4 Predicted probabilities of success for (a) 37 breeding pairs from the 2014 and 2015 Fennec Fox Breeding and Transfer Plans
and (b) 26 breeding pairs from the 2016 Mexican Wolf Breeding and Transfer Plan generated by four different modeling strategies. Filled
circles represent the actual results of the breeding recommendations (1 = success, 0 = failure)

         The RVA examines factors objectively, at least for biological and   as part of the new species recovery plan (USFWS, 2017).
pair-related variables, in a relatively straightforward and consistent       Additionally, because we know that periods of contraception and
way that may identify key variables not previously thought to be             periods of non-breeding can affect fertility and reproductive health
important. No single RVA model will perfectly predict the outcomes of        (Asa et al., 2014; Penfold et al., 2014 and references therein), the
breeding pairs, and over time, as more data are added to the dataset,        AZA RMC is developing another modeling approach called Lifetime
these models will change. The RVA is not meant to make perfect               Reproductive Planning (LRP) to model the demographic and genetic
predictions, but rather to find primary drivers of reproductive success      impacts of various reproductive management scenarios (e.g., breed
or failure to advise population management in order to meet genetic          early and often, intersperse contraception with gender separation
and demographic goals.                                                       during non-breeding cycles, or breed and cull). These stochastic LRP
         While RVA results can be used solely to improve breeding            models, like PVAs, can utilize the RVA results to parameterize the
efficiency, they also can be utilized as parameters for other analyses       models. LRP should also assist program leaders by modeling best
related to population sustainability. PVAs (see Lacy, this issue and         strategies to space pregnancies that would facilitate females being
Che-Castaldo et al., this issue) are important tools in predicting how       bred at younger ages (prime fertility) while maintaining demographic
animal populations will perform over time with regard to genetics,           and genetic goals as well as target population sizes.
demographics, and persistence. An understanding of the variables                 Effective management of zoo populations has never been more
that affect the reproductive performance of individuals and breeding         important, with increasingly human-dominated landscapes and more
pairs/groups is critical to making PVAs more reliable. For example,          species becoming “conservation reliant” (Redford, Amato, & Baillie,
RVA results were used in the recent Mexican Wolf PVA conducted               2011; Scott, Goble, Haines, Wiens, & Neel, 2010). An increasing number
BAUMAN     ET AL.
                                                                                                                                                                    |   65

of species will require intensive management to ensure their long-term               Asa, C. S., & Valdespino, C. (1998). Canid reproductive biology: An
persistence (IUCN SSC, 2014). Tools like RVA can enable AZA program                      integration of proximate mechanisms and ultimate causes. Integrative &
                                                                                         Comparative Biology, 38(1), 251–259.
leaders to better understand reproductive dynamics in their populations
                                                                                     Ballou, J. D., Lees, C., Faust, L. J., Long, S., Lynch, C., Bingaman Lacey, L., . . .
and provide them with actionable recommendations on how to                               Foose, T. J.(2010). Demographic and genetic management of captive
maximize reproduction success critical for population sustainability.                    populations. In D. G. Kleiman, K. V. Thompson, & C. K. Baer (Eds.), Wild
                                                                                         mammals in captivity: Principles and techniques for zoo management (pp.
                                                                                         219–252). Chicago: University of Chicago Press.
5 | C ONC LU SI ON S                                                                 Bauman, K. L., Mekarska, A., Grisham, J., & Lynch, C. (2010). Small canid
                                                                                         husbandry challenges: Reviewing problems, with recommendations for
                                                                                         improving captive canid programmes. In C. S. Asa & A. Kitchener (Eds.),
 If the ex situ community is to be increasingly relied upon as an equal
                                                                                         Canids and bears, international zoo yearbook (pp. 87–101). London,
  partner in integrated conservation initiatives, we must assure that                    England: The Zoological Society of London.
  cooperative breeding programs are efficient and we are managing                    Burnham, K. P., Anderson, D. R., & Huyvaert, K. P. (2011). AIC model
  robust, viable populations.                                                            selection and multimodel inference in behavioral ecology: Some
                                                                                         background, observations, and comparisons. Behavioral Ecology and
 The RVA is a tool that analyzes the inherent biological and
                                                                                         Sociobiology, 65(1), 23–35.
  reproductive characteristics of individual animals (e.g., age, parity,             Byers, O., Lees, C., Wilcken, J., & Schwitzer, C. (2013). The One Plan
  rearing type) and of breeding pairs (e.g., experience as a pair, age                   Approach: The philosophy and implementation of CBSG's approach to
  difference) that correlate with successful reproduction in a given                     integrated species conservation planning. WAZA Magazine, 14, 2–5.
                                                                                     Che-Castaldo, et al. (2019). Patterns in the long-term viability of North
  species.
                                                                                         American zoo populations. Zoo Biology, 38, 78–94.
 RVAs can be a useful endpoint for some populations. Lessons                        Cohen, A. (2004). Female post-reproductive lifespan: A general mammalian
  learned in these analyses can be operationalized to improve                            trait. Biological Reviews, 79(4), 733–750.
  breeding efficiency and make populations more sustainable.                         Conde, D. A., Flesness, N., Colchero, F., Jones, O. R., & Scheuerlein, A.
                                                                                         (2011). An emerging role of zoos to conserve biodiversity. Science, 331,
  Further, RVA results also can be informative for other analyses
                                                                                         1390–1391.
  related to population sustainability that may be needed for other
                                                                                     Conde, D. A., Colchero, F., Gusset, M., Pearce-Kelly, P., Byers, O., Flesness,
  populations such as PVAs or Lifetime Reproductive Planning. These                      N., Browne, R. K., & Jones, O. R. (2013). Zoos through the lens of the
  data-driven models will benefit from findings provided by RVA and                      IUCN red list: A global metapopulation approach to support conserva-
  stochasticity within the factors driving reproductive success can be                   tion breeding programs. PLoS ONE, 8, 1–9.
                                                                                     Conde, D. A., Colchero, F., Guneralp, B., Gusset, M., Skolnik, B., Parr, M., . . .
  built into these models.
                                                                                         Fa, J. (2015). Opportunities and costs for preventing vertebrate
                                                                                         extinctions. Current Biology, 25, 219–221.
                                                                                     Daigle, C. L., Brown, J. L., Carlstead, K., Pukazhenthi, B., Freeman, E. W., &
ACKNOWLEDGMENTS
                                                                                         Snider, R. J. (2015). Multi-institutional survey of social, management,
The authors acknowledge the efforts of Brenda Gonzalez, Jenny                            husbandry and environmental factors for the SSP African lion Panthera
                                                                                         leo population: Examining the effects of a breeding moratorium in relation
Jankovitz, Erin Klein, and Bruna Wilhelm who assisted in the data
                                                                                         to reproductive success. International Zoo Yearbook, 49, 198–213.
gathering for these two species, as well as Peter Siminski, the AZA                  Dochtermann, N. A., & Jenkins, S. H. (2011). Developing multiple
Mexican Wolf SSP Coordinator. We also thank the anonymous                                hypotheses in behavioral ecology. Behavioral Ecology and Sociobiology,
reviewers for comments that strengthened this paper.                                     65, 37–45.
                                                                                     Faust, L. J., Theis, M., Long, S., & Shell, S. (2011). PMCTrack: A Website for
                                                                                         Monitoring Breeding and Transfer Recommendations for Zoo Pro-
ORCID                                                                                    grams. Lincoln Park Zoo. https://www.pmctrack.org
                                                                                     Faust, L. J., Bergstrom, Y. M., Thompson, S. D., & Bier, L. (2012). PopLink
Karen Bauman          http://orcid.org/0000-0001-8964-9575                               Version 2.4. Chicago, IL: Lincoln Park Zoo.
                                                                                     Faust, et al. (2019). Uncovering challenges to sustainability of AZA Animal
Ashley Franklin       http://orcid.org/0000-0002-0818-5156
                                                                                         Programs by evaluating the outcomes of breeding and transfer
Kathy Traylor-Holzer         http://orcid.org/0000-0002-3816-6706                        recommendations with PMCTrack. Zoo Biology, 38, 24–35.
David Powell        http://orcid.org/0000-0002-1462-2826                             Hoffmann, M., Hilton-Taylor, C., Angulo, A., Böhm, M., Brooks, T. M.,
                                                                                         Butchart, S. H., . . . Stuart, S. N. (2010). The impact of conservation on
                                                                                         the status of the world's vertebrates. Science, 330, 1503–1509.
                                                                                     IUCN SSC. (2014). Guidelines on the Use of Ex Situ Management for Species
REFERENCES
                                                                                         Conservation. Version 2.0. Gland, Switzerland: IUCN Species Survival
Agnew, M., & Asa, C. S. (2014). Diagnosis, Treatment and Prevention of                   Commission.
   Infertility Workshop. Workshop Proceedings: AZA Mid-Year Meeting,                 James, G., Witten, D., Hastie, T., & Tibshirani, R. (2014). An Introduction to
   Memphis, TN. Saint Louis, MO: AZA Wildlife Contraception Center.                      Statistical Learning: With Applications in R. United States of America:
Asa, C. S., Bauman, K. L., Devery, S., Zordan, M., Camilo, G. R., & Boutelle, S.         Springer Publishing.
   (2014). Factors associated with uterine endometrial hyperplasia and               Jiménez-Valverde, A. (2012). Insights into the area under the receiver
   pyometra in wild canids: Implications for fertility. Zoo Biology, 33, 8–19.           operating characteristic curve (AUC) as a discrimination measure in
Asa, C., Miller, P., Agnew, M., Rebolledo, J. A. R., Lindsey, S. L., Callahan, M.,       species distribution modelling. Global Ecology and Biogeography, 21,
   & Bauman, K. (2007). Relationship of inbreeding with sperm quality and                498–507.
   reproductive success in Mexican gray wolves. Animal Conservation, 10,             Lacy, R. C. (2019). Lessons from 30 years of population viability analysis of
   326–331.                                                                              wild populations. Zoo Biology, 38, 67–77.
66   |                                                                                                                                                BAUMAN    ET AL.

Lees, C. M., & Wilcken, J. (2009). Sustaining the ark: The challenges faced by         Soule, M., Gilpin, M., Conway, W., & Foose, T. (1986). The millenium ark:
    zoos in maintaining viable populations. International Zoo Yearbook, 43,                How long a voyage, how many staterooms, how many passengers? Zoo
    6–18.                                                                                  Biology, 5, 101–113.
Leus, K., Bingaman Lackey, L., van Lint, W., de Man, D., Riewald, S.,                  Strobl, C., Boulesteix, A., Kneib, T., Augustin, T., & Zeileis, A. (2008).
    Veldkam, A., & Wijmans, J. (2011). Sustainability of European                          Conditional variable importance for random forests. BMC Bioinformat-
    Association of Zoos and Aquaria bird and mammal populations.                           ics, 9, 307.
    WAZA Magazine, 12, 11–14.                                                          Strobl, C., Malley, J., & Tutz, G. (2009). An introduction to recursive
Lockyear, K., Waddell, W., Goodrowe, K., & MacDonald, S. (2009).                           partitioning: Rationale, application, and characteristics of classification
    Retrospective investigation of captive red wolf reproductive success                   and regression trees, bagging, and random forests. Psychological
    in relation to age and inbreeding. Zoo Biology, 28, 214–229.                           Methods, 14, 323–348.
Long, S., Dorsey, C., & Boyle, P. (2011). Status of Association of Zoos and            Symonds, M. R. E., & Moussalli, A. (2011). A brief guide to model selection,
    Aquariums cooperatively managed populations. WAZA Magazine, 12,                        multimodel inference and model averaging in behavioural ecology using
    15–18.                                                                                 Akaike's information criterion. Behavioral Ecology and Sociobiology, 65,
Martin-Wintle, et al. (2019). Improving the sustainability of captive                      13–21.
    populations with free mate choice. Zoo Biology, 38, 119–132.                       Traylor-Holzer, K., Leus, K., & Byers, O. (2018). Integrating ex situ
Maunder, M., & Byers, O. (2005). The IUCN Technical Guidelines on the                      management options as part of a one plan approach to species
    Management of Ex Situ Populations for Conservation: Reflecting major                   conservation. In B. A. Minteer, J. Maienschein, & J. P. Collins (Eds.), The
    changes in the application of ex situ conservation. Oryx, 39, 95–98.                   ark and beyond: The evolution of zoo and aquarium conservation. Chicago,
McGowan, P. J. K., Traylor-Holzer, K., & Leus, K. (2016). IUCN guidelines for              Illinois: University of Chicago Press.
    determining when and how ex situ management should be used in                      Traylor-Holzer, K., Leus, K., & Bauman, K. L. (this issue). Integrated
    species conservation. Conservation Letters, 10, 361–366.                               collection assessment and planning (ICAP) workshop: Helping zoos
Penfold, L. M., Powell, D., Traylor-Holzer, K., & Asa, C. S. (2014). “Use it or            move forward toward the one plan approach. Zoo Biology, xx, xx–xx.
    lose it”: Characterization, implications, and mitigation of female                 U.S. Fish and Wildlife Service. (2017). Mexican wolf recovery plan (Canis
    infertility in captive wildlife. Zoo Biology, 33, 2–8.                                 lupus baileyi), First Revision. Albuquerque, NM: U.S. Fish and Wildlife
Powell, D. M., Dorsey, C. L., & Faust, L. J. (2019). Advancing the science                 Service.
    behind animal program sustainability: An overview of the special issue.            Valdespino, C., Asa, C. S., & Bauman, J. E. (2002). Estrous cycles, copulation,
    Zoo Biology, 38, 5–11.                                                                 and pregnancy in the fennec fox (Vulpes zerda). Journal of Mammalogy,
Pritchard, D. J., Fa, J. E., Oldfield, S., & Harrop, S. R. (2011). Bring the captive       83(1), 99–109.
    closer to the wild: Redefining the role of ex situ conservation. Oryx, 46,
    18–23.
R Core Team. (2015). R: A language and environment for statistical computing.          SUPPORTING INFORMATION
    Vienna, Austria: R Foundation for Statistical Computing. URL http://
    www.R-project.org/.                                                                Additional supporting information may be found online in the
Redford, K. H., Amato, G., & Baillie, J. (2011). What does it mean to                  Supporting Information section at the end of the article.
    successfully conserve a (vertebrate) species? BioScience, 61, 39–48.
Ricklefs, R. E., Scheuerlein, A., & Cohen, A. (2003). Age-related patterns of
    fertility in captive populations of birds and mammals. Experimental
    Gerontology, 38(7), 741–745.
Saunders, S. P., Harris, T., Traylor-Holzer, K., & Goodrowe-Beck, K. (2014).               How to cite this article: Bauman K, Sahrmann J, Franklin A,
    Factors influencing breeding success, ovarian cyclity, and cub survival in             et al. Reproductive Viability Analysis (RVA) as a new tool for
    zoo-managed tigers. Animal Reproductive Science, 14, 38–47.                            ex situ population management. Zoo Biology. 2019;38:55–66.
Scott, J. M., Goble, D. D., Haines, A. M., Wiens, J. A., & Neel, M. C. (2010).
                                                                                           https://doi.org/10.1002/zoo.21477
    Conservation-reliant species and the future of conservation. Conserva-
    tion Letters, 3, 91–97.
You can also read