Which of the following statements best predicts the effect that a change from a moderately acidic?

1 Introduction

In humans and other animals, the blood is responsible for functions essential to sustain life, including the transport of gases and nutrients, regulation of body temperature, and importantly, the repair of damaged blood vessels (i.e., clotting). This process involves the activation and adhesion of platelets and fibrin to form a platelet plug that ceases the blood loss (Lee et al., 2014; Hoffbrand et al., 2016). The blood coagulation pathway consists of a well-orchestrated series of protein activation and complex formation, and involves more than 10 different components, termed coagulation factors (Lee et al., 2014; Hoffbrand et al., 2016). Disruptions of this delicate system often leads to hemorrhage or thrombosis.

Among these blood coagulation disorders is hemophilia B (HB), a relatively rare condition affecting 1 in ∼50,000 live births, caused by mutations in the coagulation factor 9 gene (F9) (Lee et al., 2014). The human F9 gene is located on the X chromosome, has 34 kb and after transcription it produces an 8-exon mRNA molecule encompassing 2,802 bp. The encoded protein has 461 amino acids, and after removal of the 46 residues signal- and leader peptides, a 415 mature protein is produced (Anson et al., 1984). Following an injury and the consequent trigger of the coagulation cascade, FIX is activated on a two-step calcium-dependent operation by the FVIIa/Tissue Factor complex and by FXIa. These activation steps result in the removal of a peptide spanning residues 192-226, and produce a FIXa with a light- and a heavy-chain [residues 47-191 and 227-461, respectively (Di Scipio et al., 1978; Bajaj et al., 1983)].

The FIXa protein has four domains (Gla, EGF1, EGF2, and serine protease). The Gla domain is involved in binding the phospholipid membrane of platelets (Rawala-Sheikh et al., 1992), the tandem copies of the EGF domain are involved in binding other coagulation factors (Wilkinson et al., 2002; Zhong et al., 2002), and the serine protease domain (SP), which comprises about half of the FIXa’s mass, contains the amino acid triad responsible for the FX activation (Brandstetter et al., 1995).

Although FIX exhibits a relatively simple domain architecture, substitutions of amino acids often lead to the disruption of the FIX catalytic activity, as indicated by more than 1,000 mutations reported to date (Rallapalli et al., 2013). These mutations cause HB with different symptoms (White et al., 2001), ranging from mild cases with only occasional bleeding episodes (5%–40% of the normal FIX activity), to moderate (1%–5% of the normal FIX activity), and severe cases (less than 1% of the normal FIX activity).

For patients who have access to treatment, it consists of periodic prophylactic injections of recombinant FIX to prevent bleeding episodes. Recently, clinical trials have demonstrated the feasibility of gene therapy, whereby an adenovirus was modified to introduce the F9 gene in the liver of patients to generate a steady production of FIX (George et al., 2017). Although these treatment options dramatically improved the quality-of-life of HB patients, the development of inhibitory antibodies in 1.5%–3% of patients (Santoro et al., 2018), the short half-life of recombinant products (Franchini et al., 2013), and the toxicity associated with the high doses necessary for efficient gene therapy (Manno et al., 2006), indicate that HB therapeutics still require further improvements.

In this sense, as attested by the fact that some FIX mutants—either natural (Simioni et al., 2009) or engineered (Nair et al., 2021)—dramatically increase the catalytic activity and the half-life of FIX, it is clear that a deep understanding of the FIX structure and function is crucial to accelerate the development of more potent and less immunogenic FIX constructs.

To address this issue, we created an in silico network representation of the FIXa structure—a residue interaction network (RIN)—where each of its residues is a node, and two nodes are connected by an edge if they are in close proximity to each other in the FIXa 3D structure. As we reported previously for FVIII (Lopes et al., 2021a; Lopes et al., 2021b), this novel representation allowed us to calculate several centrality measures of each amino acid, effectively quantifying their importance in the FIXa structure and indicating which amino acids are more or less tolerant to substitutions. To ensure the robustness of this approach, we carefully validated our in silico findings against hundreds of clinical reports associating mutations to the severity of the HB symptoms.

Next, we created an open-source machine learning framework called HemB-Class to generalize these findings and predict the effects of mutations of all FIXa residues to all 19 remaining amino acids. Notably, we verified that we could use the HemB-Class framework to disambiguate clinical reports that had conflicting results (i.e., database entries showing different severities associated to the same amino acid substitution).

Together, the findings presented here provide a comprehensive map of the FIXa protein structure, and demonstrate the feasibility of in silico tools to mechanistically quantify the characteristics of every residue of this vital coagulation factor.

2 Results

2.1 Creation of the FIXa RIN

The FIXa protein activates FX to FXa via a protealytic cleavage mediated by its amino acid triad located on the SP domain (Anson et al., 1984; Johnson et al., 2010), and this reaction is catalyzed several thousand folds by the presence of FVIIIa (Lee et al., 2014). To understand the details of this process and to design efficient recombinant therapeutic proteins, it is essential to investigate the protein structure of FIXa. Even though no complete structure of the human FIX was determined, the structures of its individual domains (Freedman et al., 1995; Rao et al., 1995; Johnson et al., 2010) and the complete porcine (Brandstetter et al., 1995) version of this protein were determined at good resolutions (1.7Å–2.8 Å). Therefore, to study the structure of FIXa we used the same strategy from a previous study that aligned the individual domains of the human FIX to the backbone of the porcine structure, and further refined it using optimization software (Rallapalli et al., 2013). We verified that in this structure, ∼30% of its residues are buried at the core of the structure, 15% present in alpha helices, 24% in beta-sheets, and more than 40% are present in loops of different shapes and sizes (Supplementary Table S1). Compared to the human FIX structure predicted by AlphaFold 2 (Tunyasuvunakool et al., 2021), the two models displayed an almost identical conformation on the heavy chain, but had considerable differences on their light-chains; this is due to the fact that the AlphaFold model was based on the complete form of the FIX protein and had low modeling confidence at several regions (Supplementary Figure S1). Given that the model we use in this study is derived from structures determined at good resolutions (1.7Å–2.8 Å), we opted to use solely our model for the analyses. Although this homology model was a “snapshot” of this coagulation factor and did not take into account the conformational changes that take place upon interaction with its partners (Freato et al., 2020), this domain alignment strategy yielded an appropriate homology model of FIXa, with more than 95% of its residues displaying good or very good conformations (Supplementary Figure S2), and was successfully used in protein binding studies (Venkateswarlu, 2010; Venkateswarlu, 2014).

Next, given that protein structures are chains of amino acids organized in a three-dimensional space, we reasoned that a network representation of the FIXa structure could offer a detailed understanding of its underlying properties. Therefore, we created a RIN where each of its amino acids is a node, and two nodes are connected by an edge if they are in close proximity to each other in the FIXa 3D structure (Methods). The edges between nodes indicate that there is either a 1) side-chain–side-chain, 2) side-chain–main-chain, 3) main-chain–main-chain hydrogen bond or non-covalent interaction between the atoms of the residues (usually located within less than ∼5 Å) (Figure 1A; Supplementary Table S2 contains the complete network). Interestingly, the FIXa RIN displayed several hydrogen bonds between residues (Supplementary Figure S3); in all domains, these residues were separated by ∼6 Å, and these bonds most likely help stabilize the FIXa structure by maintaining the correct orientation of all interacting partners.

FIGURE 1

FIGURE 1. Representation of FIXa structure as a residue network. (A) In the FIXa RIN, each node represents an amino acid, and two nodes are connected by an edge if their atoms are in close proximity (∼5 Å). (B) The degree quantifies the number of connections a residue has, the betweenness indicates how many times a node served as a bridge on the shortest path along two other amino acids, and the Burt’s constraint was derived from social science studies to quantify the position of advantage of individuals within an organization (Burt, 2009). Nodes with high-degree participate in multiple molecular interactions, and those with high-betweenness and low Burt’s constraint serve as intermediate between different groups of amino acids. In contrast, residues with low degree, low betweenness and high Burt’s constraint usually do not have many connections to other residues and are located at the periphery of the network. (C) Properties derived from the FIXa structure or from the RIN are good indicators of the severity of HB. Depicted is the solvent-accessible (areaSAS) and the solvent-excluded (areaSES) surface areas, the relative exposure of amino acids (Rel. Exposure Area), the conservation of the FIXa residues (smaller values indicate higher conservation), and the RIN centrality measures. Also depicted are measures derived from SIFT (Sim et al., 2012), Provean (2 Scores, −2.5 and 0.05) (Choi and Chan, 2015), and from Polyphen-2 (PPH2-Prob, dScore, Score 1, Score 2, MinDJxn, IdPmax, IdQmin) (Adzhubei et al., 2010). The boxplots show the median (center line), the first and third quartiles (lower- and upper-bounds), and 1.5 times the inter-quartile range (lower- and upper whiskers). Each dot in the plot is an amino acid mutation (i.e., a clinical case report). Unpaired, two-sided Wilcoxon test (***p-values < 0.001; **p-value < 0.01; *p-value < 0.05).

In total, the FIXa RIN had 360 nodes and 1,229 edges. Previous studies demonstrated that the centrality measures of amino acids in a RIN are strong indicators of the protein stability (Dokholyan et al., 2002; Yan et al., 2014; Nisthal et al., 2019) and provide valuable information about the role of residues in the protein conformation and interaction with other proteins (Reichmann et al., 2005; del Sol et al., 2006). Therefore, to quantify the centrality of the FIXa RIN, we calculated several measures based on distinct underlying principles (Figure 1B), as well as quantitative features derived directly from the protein structure, like the solvent exposed area, hydrophobicity and the psi and phi angles of each of its residues, and their conservation throughout evolution (Methods).

Next, we wondered if these features could be used as indicators of the severity of HB. Similar to other proteins (Kessel and Ben-Tal, 2010), we found that mutations of the most conserved, hydrophobic and buried residues are usually associated with severe forms of HB (Figure 1C). Moreover, we evaluated the predictive performance of 3 popular methods that are able to determine the effect of point mutations in proteins [i.e., Provean (Choi and Chan, 2015), Polyphen-2 (Adzhubei et al., 2010), SIFT (Sim et al., 2012)]. These methods output a binary classification of the most likely result of amino acid substitutions (i.e., neutral or deleterious), and numerical scores quantifying this effect. We used 393 FIXa mutations as input to these methods and verified that while their binary classifications could not predict the severity of hemophilia A (Supplementary Figure S4), their numerical scores were powerful discriminators of severe and mild/moderate cases (Figure 1C). Finally, we observed that substitutions of the most central residues of the FIXa RIN (indicated by the high-degree, high-betweenness and low Burt’s constraint values), lead to more severe symptoms. On the other hand, mutations of the less conserved residues located at the protein surface, and less central in the FIXa RIN are mainly related to mild or moderate HB symptoms (Figure 1C).

In an analogy to the train system of a large city, disturbances at the “hub” stations quickly propagate and cause the collapse of the transportation network; in a similar fashion, substitutions of the most connected residues of FIXa lead to the impairment of its function. As our results demonstrate, the FIXa RIN is able to capture the underlying properties that associate the position of each network residue to the severity of HB symptoms, and together with existing methods, these findings converge from multiple lines of evidence.

2.2 RIN Derived Measures Identify Critical RIN Residues

After verifying the suitability of the RIN to represent the FIXa structure and to quantify the importance of its residues, we aimed to identify which of them are critical for the proper functioning of this protein.

For this purpose, we compared the measures we calculated for the FIXa RIN, and found that several of them were correlated (Figure 2A). Therefore, for further analyses we selected only the least correlated measures: two well-studied centrality measures (degree and betweenness), and an index not commonly used in biological network analysis [the Burt’s constraint, derived from social science studies (Burt, 2009)].

FIGURE 2

FIGURE 2. Centrality measures from the FIXa RIN and the important residues. (A) The Spearman correlation between all measures considered in this study. (B) The degree and betweenness of all residues of the FIXa RIN. Each dot represents an amino acid, and groups of residues with different characteristics are highlighted. (C) The location of the residues highlighted in panel (B) in the FIXa protein structure. (D) The boxplot displays the betweenness and the Burt’s constraint values of the nodes taking part in atomic interactions with residues in other domains of FIXa (link nodes), compared to the nodes interacting only with residues from the same domain. (E) The residues with the highest degree, betweenness and (lowest) Burt’s constraint; these residues are most likely the most central of the whole FIXa protein. The boxplots show the median (center line), the first and third quartiles (lower- and upper-bounds), and 1.5 times the inter-quartile range (lower- and upper whiskers). Unpaired, two-sided Wilcoxon test (***p-values < 0.001; *p-value < 0.01; *p-value < 0.05).

After inspection of the degree and betweenness values of residues in the FIX RIN (Figure 2B), we divided the residues into three patterns, 1) High-Degree and High-Betweenness (HDHB), 2) Low-Degree and High-Betwenness (LDHB), and 3) Low-Degree and Low-Betwenness (LDLB) (Table 1). We found that the HDHB residues are mainly part of alpha helices or beta-strands, are connected to 12–14 other residues via non-covalent or hydrogen bonds, are buried at the core of the Gla and the SP domains, and although mutations at these residues are mainly associated to severe forms of HB, occasionally there are reports of moderate symptoms (Figure 2C). Among these residues, Phe424 is located at the edge between the SP and the EGF2 domains, and is consistently associated with severe forms of HB if mutated to leucine, valine, or serine (Chen et al., 1991; Caglayan et al., 1997; Liu et al., 2000). Moreover, we found that in the FIXa RIN, 40 residues take part in atomic interactions with residues from a different domain. Interestingly, while the degree of these residues did not differ from other residues of FIXa, their betweenness and their Burt’s constraint values were markedly different—they were more than 3 times higher compared to residues interacting only with residues from the same domain (Figure 2D; Supplementary Table S3).

TABLE 1

TABLE 1. Key-residues identified using the centralities of the FIX RIN.

The LDHB residues are located at loops and beta-strands, but serve as bridges along the shortest paths between other amino acids. These residues are located mainly at the outer regions of EGF1 and EGF2 and have neighbors at different domains, most likely stabilizing the overall FIXa conformation. Most mutations at these residues are associated to severe forms of HB (e.g., Gly125Arg (Caglayan et al., 1997); however, residues Ser107, Lys109, and Asp111 had no reports of HB, possibly because these mutations occur in humans but people carrying this mutation did not show symptoms, given that these amino acid positions are not conserved and accepted different types of amino acids throughout evolution (Supplementary Table S1).

Next, the LDLB residues are the most peripheral residues of FIXa, located at the most outer loops of the Gla, EGF1, EGF2, and SP domains (Figure 2C). While six of those residues did not have HB reported in the medical literature, the remaining had a few cases described, indicating mainly mild, and occasionally moderate or severe cases (e.g., Thr271).

Along these lines, we also verified that the Padua (Simioni et al., 2009) and the CB 2679d-GT mutants (Nair et al., 2021), known to considerably increase the activity of FIXa, have a high surface exposure and centrality values tending towards the least connected residues of the FIXa RIN. Interestingly, we observed that while most FIXa surface residues interacting with FVIIIa display low connectivity and high surface exposure, some residues eluded this trend by taking part in multiple molecular interactions with other residues (i.e., Lys347, Arg379, Leu383), and caused a major reduction of FXa generation if mutated to alanine (Kolkman et al., 1999; Bajaj et al., 2001). This suggests that although most surface residues have low centrality values in the FIXa network, some are highly connected, most likely to preserve their correct positioning within the binding sites (Reichmann et al., 2005; del Sol et al., 2006).

Together, these findings indicate that centralities measures derived from the RIN help to identify critical residues of the FIX structure, and their position within the network largely reflect the severity of HB symptoms that ensues if those residues are mutated.

Having observed that the Burt’s constraint could significantly differentiate between HB severities (Figure 1C), and that this measure had only a moderate correlation with the betweenness centrality (0.78, Spearman correlation, p-value < 0.01), we considered it together with the degree and the betweenness and used the Pareto front to identify the FIXa residues that had the highest values on all three measures. This strategy offered a strong combination of local and global centrality measures, pointing to the residues that played a critical role in its local neighborhood (high degree) as well as on distal locations of FIXa (high betweenness and low constraint values)—we termed these residues supercritical (Figure 2E; Table 1).

We found that these residues are mainly part of beta-strands, are located in the hydrophobic core of the SP domain, at a surface loop of EGF2, and within less than ∼1.5 Å of several residues of EGF1. Moreover, the substitution of these residues is strongly associated to severe HB symptoms—for instance, Trp356, Asp410, and Phe424 had combined more than 30 reports of severe HB in the EAHAD database (Rallapalli et al., 2013).

In all, these findings indicate that the connectivity of residues in a RIN provides quantifiable information reflecting their importance, and the combination of measures can uncover patterns that would otherwise remain obscured.

2.3 Development of a Machine Learning Classifier for Hemophilia B

After identifying the properties of key FIXa residues, we wondered if we could use all structural and centrality measures in conjunction to train a machine learning classifier to predict the severity of HB that ensues upon mutation of the FIXa residues. A machine learning classifier algorithm works by learning the patterns from only a part of the input dataset, and by repeatedly tuning its parameters to prioritize features that are informative to predict the class of each instance. In our case, we had 393 instances representing a FIXa mutation that caused HB in a patient (213 mild/moderate, 180 severe). Current databases do not have enough data of Type I and Type II mutations to allow us to create specific machine learning models for each type (namely, those that impair secretion and activity, or those affecting only the activity of FIXa).

The input features were the structural and centrality measures derived from the FIXa RIN and from the structure itself, the residue conservation score derived from a large multiple sequence alignment, and other measures of difference between the wild-type and the new amino acid after the substitution (Methods). Finally, the class label to be predicted was the severity of the disease (mild/moderate or severe) (Figure 3A).

FIGURE 3

FIGURE 3. The HemB-Class machine learning framework. (A) Our machine learning classifiers received as input the properties from the FIXa structure, from the FIXa RIN, the conservation score of each amino acid and measures derived from other variant prediction algorithms [SIFT (Sim et al., 2012), Provean (Choi and Chan, 2015), and Polyphen-2 (Adzhubei et al., 2010)]. The output of our classifiers is the severity of HB, derived from clinical reports from the EAHAD FIX mutation database (Rallapalli et al., 2013). (B) Comparative performance of six classifiers and a combination of the best classifiers (Ensemble—we named it HemB-Class). The bars depict the mean values of 10 repetitions of 10-fold cross validations and the error bars are the standard deviation values. (C) Spearman correlation of the predicted probabilities outputted by the classifiers. (D) The trade-off between the number of instances classified and the accuracy. Each dot is the classification performance of an individual classifiers or the ensembles when we vary the classification threshold to create an “exclusion area” to disregard instances with ambiguous classifications.

We compared the predictive power of 6 different classifiers. The input data was divided into 10 equal parts, and 9 parts were used for training and 1 part was used to evaluate (test) the performance of the classification—namely, how many instances were correctly classified as mild/moderate or severe HB. During the training phase, the hyperparameters used to control the learning process were tuned using a 10-fold cross-validation approach to avoid overfitting the models. To increase the robustness of the results, this procedure was repeated 10 times to ensure that several combinations of training and test sets were considered. Using this approach, the classifiers obtained an overall accuracy of ∼70%, indicating that the individual algorithms could learn moderately well the underlying patterns of the FIXa structure and correlate them to the severity of HB symptoms (Figure 3B).

We observed that the classifiers outputted slightly different predictions for the same instance, as reflected in the low correlation between their outputted probabilities (Figure 3C). This situation is ideal for the creation of an ensemble of classifiers–i.e., the combination of predictions from different classifiers to come closer to the real class of an instance (Dong et al., 2020). Therefore, to find the best combination of classifiers, we calculated the median of their outputted predictions considering all possible classifier combinations, from individual algorithms to all six algorithms together. Additionally, we verified that the classification accuracy improved considerably if we created an “exclusion zone” where we did not consider instances that had ambiguous classifications (Figure 3D).

The best ensemble was the combination of two well-known algorithms, namely, Random Forest (Breiman, 2001) and XGBoost (Chen and Guestrin, 2016). We named this ensemble HemB-Class. Additionally, instead of outputting a simple binary classification (e.g., mild/moderate or severe HB), we implemented HemB-Class to output a probability that a mutation will impair the function of the FIXa protein. We named this output as Severity Score and verified that it raised the accuracy of HemB-Class to more than 80% while retaining more than 70% of the instances (Figure 3D). Additionally, HemB-Class achieved sensitivity of 0.71 and specificity of 0.89, demonstrating that it could accurately distinguish between mild/moderate and severe HB cases (Supplementary Table S4).

Together, these results indicate that although HB had only a few hundred unique instances—as is often the case for rare diseases—we found that a rational combination of classifier algorithms leveraged HemB-Class’ performance and led to correct predictions of the association between amino acid substitutions and the severity of HB. Importantly, the Severity Score provided the flexibility to select the stringency of the classification, either classifying more instances with less confidence, or less instances with more certainty.

2.4 Predicting the Severity of all Possible FIX Mutations

One of the greatest assets of machine learning classifiers is their ability to predict the class of instances not used during the training phase. For this reason, we aimed to predict the severity of 1,373 HB mutations that had conflicting clinical reports (i.e., mutations at the same position, but with different symptoms).

We used HemB-Class to calculate the Severity Score of those mutations and found that our predictions largely agreed with the majority class of the reports—i.e., mutations with high Severity Scores are often associated to severe forms of HB and vice-versa (Figure 4A). These results indicate that HemB-Class can help disambiguate FIXa mutations, and narrow down the number of candidates that require a meticulous laboratory follow-up (Supplementary Table S5).

FIGURE 4

FIGURE 4. Severity Score of all possible FIXa mutations. (A) The Severity Score of mutations not used during the training phase because they had conflicting symptoms reported in the medical literature. Our predictions agreed with the majority class of each mutation (Supplementary Table S5). (B) The Severity Score predicted by the HemB-Class framework for the mutations of each FIXa residue to the 19 remaining amino acids. (C) The location of the residues with the highest Severity Scores. These residues, located at the core of each FIXa domain, are unlikely to accept any amino substitution (Supplementary Table S6). (D) The most buried residues (less than 25% relative surface exposure), have significantly higher Severity Scores than the most exposed residues. The boxplots show the median (center line), the first and third quartiles (lower- and upper-bounds), and 1.5 times the inter-quartile range (lower- and upper whiskers). Each dot in the plot is an amino acid mutation (i.e., a clinical case report). Unpaired, two-sided Wilcoxon test (***p-values < 0.001; **p-value < 0.01; *p-value < 0.05).

Next, we used HemB-Class to predict the effect of mutating all residues of FIXa to all 19 remaining amino acids (Figure 4B). We found that the core of all domains have regions that are intolerant to mutations. For instance, Glu72 and Glu73 on the Gla domain, Cys97 on EGF1, Cys141 on EGF2, and Trp261 on SP were predicted to impact the function of FIXa if mutated to most other residues, especially if the changes introduce residues with opposite charges or differing sizes (Supplementary Table S6).

Finally, we combined all predictions to identify the residues that were the most reactive to mutations—in other words, residues unlikely to accept any amino acid substitution (Figure 4C). We found that the buried residues of all domains are the regions where mutations are more likely to cause a disruptive effect; however, while previously this was only a qualitative measure in the protein structure field (i.e., buried or exposed), we effectively represented this characteristic in quantitative terms and observed a major difference between the predicted Severity Score of the most buried compared to the exposed residues (Figure 4D), suggesting that substitutions aimed at improving the activity of FIXa should take the buried and exposed thresholds into account.

In summary, these results demonstrate that a versatile machine learning framework can anticipate the effects of amino acid substitutions in FIXa, as demonstrated by the close agreement between these predictions and hundreds of clinical reports collected over the past 3 decades.

3 Discussion

In this study, we established a novel representation of the FIXa structure that enabled us to quantify the importance of all of its amino acids. We organized the FIXa structure as a residue network, where two nodes are connected if they are in close proximity to each other in the 3D structure of the FIXa protein. We found that the amino acid centrality measures derived from this network are good indicators of the severity of HB that ensues if those residues are mutated (Figure 1). Moreover, we inputted these and other structural measures into a machine learning classifier framework that we named HemB-Class, and found that it accurately predicts the severity of HB. We used this framework to disambiguate conflicting medical reports and to predict with high accuracy the extent of impairing mutations.

In comparison to FVIII, the FIX protein is relatively simple, containing 461 residues and only 4 domains. However, this simplicity also requires that all of its binding sites and catalytic regions are correctly positioned for its activity to take place (i.e., activate FX) (Lee et al., 2014; Hoffbrand et al., 2016). While major perturbations to the F9 gene are more likely to result in severe HB (e.g., deletions or introduction of premature stop codons), the effects of single-nucleotide polymorphisms are less predictable. Therefore, as the conformation of proteins is intimately related to their functions (Kessel and Ben-Tal, 2010), studying the impact of amino acid substitutions in the overall protein architecture is an essential step to link and anticipate the effects of nucleotide substitutions to the clinical symptoms of HB.

In addition to identifying properties and centrality measures associated to mild, moderate and severe HB (Figure 1C), we used the FIXa RIN to identify the residues that display relevant properties and that can either be safely substituted, or should be avoided in attempts to improve FIX’s activity and immunogenic profile (Supplementary Table S1). In particular, we observed that the positions mutated in the Padua (Simioni et al., 2009) (Arg384) and the CB 2679d-GT (Arg364, Arg384, Thr389) variants (Nair et al., 2021), known to increase FIX’s activity and stability, have a centrality profile similar to other peripheral nodes (Figures 2B–D), corroborating the idea that residues with this profile can be safely substituted without impacting the stability of FIXa. Notably, we verified a mixed composition of more and less connected residues at the FVIIIa-FIXa binding sites (Kolkman et al., 1999; Bajaj et al., 2001), suggesting that while some residues can be safely substituted, others take part in numerous molecular interactions that hold the modular structure of the binding sites in place (Dokholyan et al., 2002; Reichmann et al., 2005).

While individual structural properties and the RIN measures are good to identify critical FIXa residues, we wondered if we could leverage the overall predictive power of our approach if we used machine learning algorithms (Figure 3). Indeed, we found that after a strict training, evaluation and combination procedure, we could use the HemB-Class framework to predict the effects of mutations at FIXa positions not used during the training phase; thus, we created an index—the Severity Score—to quantify the likelihood that mutations cause a major disruption of the FIXa activity. In particular, we used the Severity Score to disambiguate several clinical HB reports that had conflicting observations, indicating that the HemB-Class captured in silico the essence of the FIXa structure (Figure 4A; Supplementary Table S5).

Finally, we explored the fullest extent of HemB-Class’ predictive power to study the effects of mutations of all FIXa residues to all 19 remaining amino acids (Figure 4B). This analysis produced a comprehensive list of residues that are likely intolerant to substitutions due to their high number of molecular interactions to other residues, their buried position and their evolutionary characteristics (Figure 4C; Supplementary Table S6); on the other hand, we found positions located at the outer loops of all FIXa domains that are more likely to accept amino acid substitutions, and are unlikely to disrupt the delicate inter-molecular network that holds the FIXa structure in place (del Sol et al., 2006; Han, 2008).

In summary, the FIXa RIN and the HemB-Class are versatile resources that can capture the intrinsic properties of the FIXa structure, and associate its features to the severity of HB. Thanks to its open source and scalable architecture, they can be immediately refined as soon as new FIX mutation reports and structures become available. Thus, we are optimistic that the findings presented here will pave the way for the rational design of better therapeutics, and that the overall methodology will be a starting point to study the underlying molecular mechanisms of other rare diseases.

4 Methods

4.1 Database Sanitation

We manually queried the European Association for Haemophilia and Allied Disorders Database (EAHAD) on 20th February 2021. At present, the EAHAD is the largest source of information about hemophilia B mutation in the public domain. It is manually curated and contains both clinical and genetic information (Rallapalli et al., 2013). We selected “Point” and “Polymorphism” (on type), and “Missense” (on variant effect) on the advanced search. Next, we removed mutations on the signal peptide regions, or outside the activated form of the protein.

Finally, we removed instances with ambiguous reported classifications (e.g., “mild/moderate,” or “moderate/severe”).

4.2 Creation of the FIXa Residue Interaction Network

To create a homology model of FIXa, the authors from a previous study (Rallapalli et al., 2013) aligned the structures of its individual domains (Freedman et al., 1995; Rao et al., 1995; Johnson et al., 2010) and the complete porcine (Brandstetter et al., 1995) version of FIX, and further refined its structure using optimization software. The domains and their resolutions were Gla: 2.80 Å, EGF1: 1.50 Å, EGF2-SP: 1.7 Å (PDB codes: 1CF1, 1EDM, and 3KCG, respectively).

We transformed the structure of the FIXa protein in an undirected, unweighted graph using RINerator version 0.5.1 (Doncheva et al., 2011) with the default parameters. This program first adds hydrogen atoms to the structure, which is essential to identify non-covalent interactions between amino acids (Word et al., 1999b), and second, it identifies the non-covalent interactions using a small probe (∼0.25 Å), rolled around the van der Waals surface of each amino acid (Word et al., 1999a), and a contact is established if the probe is simultaneously in contact with two non-covalently bonded atoms.

We considered that two residues interacted if there was at least one edge between them, independently of the edge type. To analyze the FIXa-RIN, we used R version 3.6.3 (https://www.R-project.org/) and the iGraph package, version 1.2.5 (Csardi and Nepusz, 2006). With the iGraph package, we used the function simplify to remove redundant edges and self-interactions. We calculated the degree, betweenness, closeness, Burt’s constraint (Burt, 2009), Authority Score, Page Rank-like, and the Authority Score measures.

We visualized the networks using Cytoscape version 3.8.2 (Shannon et al., 2003).

Finally, we obtained the conservation score from the ConsurfDB webserver (Ben Chorin et al., 2020), using the FIXa protein structure as input for the search query.

4.3 Calculation of the FIXa Protein Structure Properties

We used Chimera version 1.14 (Pettersen et al., 2004) to extract the solvent-excluded area (areaSES) and to calculate the relative surface exposure of all amino acids from the customized FIXa structure. We divided the solvent-excluded area of the residue by the surface area of the same type of residue in a reference state; in our case, we used the reference values of the 20 standard amino acids in Gly-X-Gly tripeptides (Bendell et al., 2014). Other measures calculated with Chimera were areaSAS, kdHydrophobicity, PSI, and PHI, for each residue of the FIXa structure.

To predict the secondary structure elements, we used the FIXa sequence as input to STRIDE (Frishman and Argos, 1995), and to determine whether the residue was buried of exposed, we divided the relative surface exposure area (relSESA) of each amino acid by the maximum value of all FIXa residues. Values below 0.25 were considered buried, otherwise, they were considered exposed.

For other measures, we used 393 FIXa single-point mutations as input to SIFT (Sim et al., 2012), Provean (Choi and Chan, 2015), and from Polyphen-2 (Adzhubei et al., 2010). For SIFT, we used the swiss_prot_2010_09 database, and a value of 0 for the median conservation of sequences.

4.4 Amino Acid Distance Index

We used the R package seqinR (Charif and Lobry, 2007) to obtain 544 numerical properties of each amino acid. Next, we used the package AMAP (Lucas, 2014) to perform a principal component analysis (PCA) of this set, and reduced the number of properties to 19 components while retaining 99% of the information in the dataset. Next, we calculated the Euclidean distance between all amino acid, considering all 19 component values. This gave us a 20 x 20 matrix which was the distance index used in our analyses (Supplementary Table S1).

4.4.1 Machine Learning

We used supervised machine learning (ML) algorithms to analyze instances of FIXa mutations (input space χ) to predict different HB severities (output labels Ƴ). The learning process was executed in three steps. First (preprocessing), we organized the input space χ to be used as input for the ML algorithms. We removed all instances with a missing value in any FIXa feature. Then, we normalized the FIXa features to the interval [0, 1]. Next, we used a stratified 10-fold cross-validation strategy to find the best possible ML models from the mapping f: χ→Ƴ. This strategy randomly splits the input space in ten parts, respecting the original distribution of the output labels (213 mild/moderate and 180 severe). During this phase, the optimal ML models (considering different ML algorithms) are obtained by iteratively using 9 folds for training and 1 fold to evaluate the output of the algorithms. Finally, the final performance of such models was assessed using validation methods to compare the expected and the predicted HB severity for a set of unseen examples. The last two steps were repeated 10 times to ensure that the results were consistent despite random fluctuations. The validation methods used here were the accuracy, Kappa Coefficient, Matthews Correlation Coefficient (MCC), and Area under the ROC curve (AUC). The accuracy is used to determine the number of instances classified correctly. The Kappa Coefficient measures the agreement between the predicted and the expected severity, emphasizing that the results were not obtained by chance. The MCC uses a contingency matrix, produced by the expected and the predicted severity, to compare classifiers in a way similar to the Pearson’s correlation coefficient. Finally, the AUC uses a contingence matrix to create a curve between the TPR (True Positive Rate) and FPR (False Positive Rate) values. As the area under the curve approaches 1, the quality of the classification increases.

The ML algorithms used in our study were: Decision Trees (DT) (Breiman, 1984), XGBoost (Chen and Guestrin, 2016), Random Forest (RF) (Breiman, 2001), and Support Vector Machine (SVM) (Vapnik, 2000). Our ensemble was built on top of Random Forest and XGBoost, whose combination provided the best results.

For all ML algorithms, the training step relied on a grid search strategy to determine the best parametrization. The DT model was optimized by varying the minimum number of observations in a node before splitting the data within the interval [2, 50]. The minimum number of observations in a terminal node (leaf) was searched in the interval [1, 35]. Finally, we looked for the optimal complexity parameter (cp) within the range [0.0001, 1]. We trained the Random Forest (RF) model by varying the number of trees (ntree) in the interval [4,100], the number of variables randomly sampled as candidates at each split (mtry) in the interval [2, 7], and minimum size of terminal nodes or leaves (nodesize) between [1, 5]. The Naïve Bayes model was estimated by only varying the Laplace smoothing, to avoid handling with zero probabilities, in the interval [0, 1]. The SVM (Support Vector Machine) models were adjusted using the two best kernels: radial ϵ(−y[x −ω]2), and polynomial (yω′x+c)d, such that x is a vector representing the training data and ω is the kernel coefficient varying in [0, 0.1, 0.2, ..., 2]. For the radial kernel, we analyzed the following parameters y = [0.01, 0.02, ..., 1.5], while the polynomial kernel was assessed using c = [0, 0.1, 0.2, ..., 2], d = {2, 3, 4, 5}. Finally, XGBoost was optimized considering the maximum depth of a tree in the interval [1, … , 25], and the learning rate (parameter ɳ) in the interval [0, 0.5].

In our experiments, we used the R statistical package 3.6.3 and the MLR package (Bischl et al., 2016) (version 2.19.0), which provides a machine learning interface to train models by using hyperparameter tuning, cross validation, feature selection, ensemble construction, and model validation. Internally, the MLR package calls the e1071 package (version 1.4.1.1 - https://cran.r-project.org/web/packages/e1071/index.html) to create the SVM model, the XGBoost package (v1.7-6) (Chen and Guestrin, 2016) to create the ensemble model using the gradient boosting approach, and the rpart package (v4.1-15) (Breiman, 1984) to create the DT model. All packages are available at the CRAN repository (https://cran.r-project.org).

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author. The HemB-Class source code and datasets developed in this study are available at https://github.com/ricardoarios/HemB-Class.

Author Contributions

TL conceptualized the study designed the analysis. TL, TN, and RR performed the analyses, interpreted the results and wrote the manuscript.

Funding

TL is supported by the Council for Science, Technology and Innovation (CSTI), Cross-ministerial Strategic Innovation Promotion Program (SIP), “Innovative AI Hospital System,” by the National Institute of Biomedical Innovation, Health and Nutrition (NIBIOHN), Grant number SIPAIH20D01, JSPS KAKENHI (JP22K06119), and the National Center for Child Health and Development internal grant (2022B-2). RAJ is supported by a grant from the Terumo Life Science Foundation, and CAPES (Coordination for the Improvement of Higher Education Personnel—Brazilian federal government agency). TNR is supported by a grant from the Terumo Life Science Foundation.

Conflict of Interest

TL received consulting fees from Pola Chemical Industries, Japan, and speaker honoraria from Sanofi Japan.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fbinf.2022.912112/full#supplementary-material

References

Adzhubei, I. A., Schmidt, S., Peshkin, L., Ramensky, V. E., Gerasimova, A., Bork, P., et al. (2010). A Method and Server for Predicting Damaging Missense Mutations. Nat. Methods 7 (4), 248–249. doi:10.1038/nmeth0410-248

PubMed Abstract | CrossRef Full Text | Google Scholar

Anson, D. S., Choo, K. H., Rees, D. J., Giannelli, F., Gould, K., Huddleston, J. A., et al. (1984). The Gene Structure of Human Anti-Haemophilic Factor IX. EMBO J. 3 (5), 1053–1060. doi:10.1002/j.1460-2075.1984.tb01926.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Bajaj, S. P., Rapaport, S. I., and Russell, W. A. (1983). Redetermination of the Rate-Limiting Step in the Activation of Factor IX by Factor XIa and by Factor VIIa/Tissue Factor. Explanation for Different Electrophoretic Radioactivity Profiles Obtained on Activation of 3H- and 125I-Labeled Factor IX. Biochemistry 22 (17), 4047–4053. doi:10.1021/bi00286a009

PubMed Abstract | CrossRef Full Text | Google Scholar

Bajaj, S. P., Schmidt, A. E., Mathur, A., Padmanabhan, K., Zhong, D., Mastri, M., et al. (2001). Factor IXa:factor VIIIa Interaction. Helix 330-338 of Factor Ixa Interacts with Residues 558-565 and Spatially Adjacent Regions of the A2 Subunit of Factor VIIIa. J. Biol. Chem. 276 (19), 16302–16309. doi:10.1074/jbc.M011680200

PubMed Abstract | CrossRef Full Text | Google Scholar

Ben Chorin, A., Masrati, G., Kessel, A., Narunsky, A., Sprinzak, J., Lahav, S., et al. (2020). ConSurf-DB: An Accessible Repository for the Evolutionary Conservation Patterns of the Majority of PDB Proteins. Protein Sci. 29 (1), 258–267. doi:10.1002/pro.3779

PubMed Abstract | CrossRef Full Text | Google Scholar

Bendell, C. J., Liu, S., Aumentado-Armstrong, T., Istrate, B., Cernek, P. T., Khan, S., et al. (2014). Transient Protein-Protein Interface Prediction: Datasets, Features, Algorithms, and the RAD-T Predictor. BMC Bioinforma. 15, 82. doi:10.1186/1471-2105-15-82

PubMed Abstract | CrossRef Full Text | Google Scholar

Bischl, B., Lang, M., Kotthoff, L., Schiffner, J., Richter, J., Studerus, E., et al. (2016). mlr: Machine Learning in R. J. Mach. Learn. Res. 17 (1), 5938–5942.

Google Scholar

Brandstetter, H., Bauer, M., Huber, R., Lollar, P., and Bode, W. (1995). X-ray Structure of Clotting Factor IXa: Active Site and Module Structure Related to Xase Activity and Hemophilia B. Proc. Natl. Acad. Sci. U. S. A. 92 (21), 9796–9800. doi:10.1073/pnas.92.21.9796

PubMed Abstract | CrossRef Full Text | Google Scholar

Breiman, L. (1984). Classification and Regression Trees. Belmont, Calif: Wadsworth International Group.

Google Scholar

Burt, R. S. (2009). Structural Holes: The Social Structure of Competition. Cambridge, MA: Harvard University Press.

Google Scholar

Caglayan, S. H., Gokmen, Y., Aktuglu, G., Gurgey, A., and Sommer, S. S. (1997). Mutations Associated with Hemophilia B in Turkish Patients. Hum. Mutat. 10 (1), 76–79. doi:10.1002/(SICI)1098-1004(1997)10:1<76::AID-HUMU11>3.0.CO;2-X

PubMed Abstract | CrossRef Full Text | Google Scholar

Charif, D., and Lobry, J. R. (2007). “SeqinR 1.0-2: A Contributed Package to the R Project for Statistical Computing Devoted to Biological Sequences Retrieval and Analysis,” in Structural Approaches to Sequence Evolution. Editors U. Bastolla, M. Porto, H. E. Roman, and M. Vendruscolo (Berlin, Heidelberg: Springer), 207–232. doi:10.1007/978-3-540-35306-5_10

CrossRef Full Text | Google Scholar

Chen, S. H., Zhang, M., Lovrien, E. W., Scott, C. R., and Thompson, A. R. (1991). CG Dinucleotide Transitions in the Factor IX Gene Account for about Half of the Point Mutations in Hemophilia B Patients: A Seattle Series. Hum. Genet. 87 (2), 177–182. doi:10.1007/BF00204177

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, T., and Guestrin, C. (2016). “XGBoost: A Scalable Tree Boosting System,” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '16) (New York, NY: Association for Computing Machinery), 785–794. doi:10.1145/2939672.2939785

CrossRef Full Text | Google Scholar

Choi, Y., and Chan, A. P. (2015). PROVEAN Web Server: A Tool to Predict the Functional Effect of Amino Acid Substitutions and Indels. Bioinformatics 31 (16), 2745–2747. doi:10.1093/bioinformatics/btv195

PubMed Abstract | CrossRef Full Text | Google Scholar

Csardi, G., and Nepusz, T. (2006). The Igraph Software Package for Complex Network Research. Int. J. Complex Syst. 1695 (5), 1–9.

Google Scholar

del Sol, A., Fujihashi, H., Amoros, D., and Nussinov, R. (2006). Residue Centrality, Functionally Important Residues, and Active Site Shape: Analysis of Enzyme and Non-Enzyme Families. Protein Sci. 15 (9), 2120–2128. doi:10.1110/ps.062249106

PubMed Abstract | CrossRef Full Text | Google Scholar

Dokholyan, N. V., Li, L., Ding, F., and Shakhnovich, E. I. (2002). Topological Determinants of Protein Folding. Proc. Natl. Acad. Sci. U. S. A. 99 (13), 8637–8641. doi:10.1073/pnas.122076099

PubMed Abstract | CrossRef Full Text | Google Scholar

Doncheva, N. T., Klein, K., Domingues, F. S., and Albrecht, M. (2011). Analyzing and Visualizing Residue Networks of Protein Structures. Trends Biochem. Sci. 36 (4), 179–182. doi:10.1016/j.tibs.2011.01.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Dong, X., Yu, Z., Cao, W., Shi, Y., and Ma, Q. (2020). A Survey on Ensemble Learning. Front. Comput. Sci. 14 (2), 241–258. doi:10.1007/s11704-019-8208-z

CrossRef Full Text | Google Scholar

Franchini, M., Frattini, F., Crestani, S., Sissa, C., and Bonfanti, C. (2013). Treatment of Hemophilia B: Focus on Recombinant Factor IX. Biologics 7, 33–38. doi:10.2147/BTT.S31582

PubMed Abstract | CrossRef Full Text | Google Scholar

Freato, N., Ebberink, E. H. T. M., van Galen, J., Fribourg, C., Boon-Spijker, M., van Alphen, F. P. J., et al. (2020). Factor VIII-Driven Changes in Activated Factor IX Explored by Hydrogen-Deuterium Exchange Mass Spectrometry. Blood 136 (23), 2703–2714. doi:10.1182/blood.2020005593

PubMed Abstract | CrossRef Full Text | Google Scholar

Freedman, S. J., Furie, B. C., Furie, B., and Baleja, J. D. (1995). Structure of the Calcium Ion-Bound Gamma-Carboxyglutamic Acid-Rich Domain of Factor IX. Biochemistry 34 (38), 12126–12137. doi:10.1021/bi00038a005

PubMed Abstract | CrossRef Full Text | Google Scholar

George, L. A., Sullivan, S. K., Giermasz, A., Rasko, J. E. J., Samelson-Jones, B. J., Ducore, J., et al. (2017). Hemophilia B Gene Therapy with a High-Specific-Activity Factor IX Variant. N. Engl. J. Med. 377 (23), 2215–2227. doi:10.1056/NEJMoa1708538

PubMed Abstract | CrossRef Full Text | Google Scholar

Hoffbrand, A. V., Higgs, D. R., Keeling, D., and Mehta, A. B. (2016). Postgraduate Haematology. Chichester, West Sussex; Hoboken, NJ: John Wiley & Sons.

Google Scholar

Johnson, D. J., Langdown, J., and Huntington, J. A. (2010). Molecular Basis of Factor IXa Recognition by Heparin-Activated Antithrombin Revealed by a 1.7-A Structure of the Ternary Complex. Proc. Natl. Acad. Sci. U. S. A. 107 (2), 645–650. doi:10.1073/pnas.0910144107

PubMed Abstract | CrossRef Full Text | Google Scholar

Kessel, A., and Ben-Tal, N. (2010). Introduction to Proteins: Structure, Function, and Motion. United Kingdom: CRC Press.

Google Scholar

Kolkman, J. A., Lenting, P. J., and Mertens, K. (1999). Regions 301-303 and 333-339 in the Catalytic Domain of Blood Coagulation Factor IX Are Factor VIII-Interactive Sites Involved in Stimulation of Enzyme Activity. Biochem. J. 339 (Pt 2), 217–221. doi:10.1042/0264-6021:3390217

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, C. A., Berntorp, E., and Hoots, K. (2014). Textbook of Hemophilia. Chichester, West Sussex: John Wiley & Sons.

Google Scholar

Liu, J. Z., Li, X., Drost, J., Thorland, E. C., Liu, Q., Lind, T., et al. (2000). The Human Factor IX Gene as Germline Mutagen Test: Samples from Mainland China Have the Putatively Endogenous Pattern of Mutation. Hum. Mutat. 16 (1), 31–36. doi:10.1002/1098-1004(200007)16:1<31::AID-HUMU6>3.0.CO;2-I

PubMed Abstract | CrossRef Full Text | Google Scholar

Lopes, T. J. S., Rios, R., Nogueira, T., and Mello, R. F. (2021a). Prediction of Hemophilia A Severity Using a Small-Input Machine-Learning Framework. NPJ Syst. Biol. Appl. 7 (1), 22. doi:10.1038/s41540-021-00183-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Lopes, T. J. S., Rios, R., Nogueira, T., and Mello, R. F. (2021b). Protein Residue Network Analysis Reveals Fundamental Properties of the Human Coagulation Factor VIII. Sci. Rep. 11 (1), 12625. doi:10.1038/s41598-021-92201-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Manno, C. S., Pierce, G. F., Arruda, V. R., Glader, B., Ragni, M., Rasko, J. J., et al. (2006). Successful Transduction of Liver in Hemophilia by AAV-Factor IX and Limitations Imposed by the Host Immune Response. Nat. Med. 12 (3), 342–347. doi:10.1038/nm1358

PubMed Abstract | CrossRef Full Text | Google Scholar

Nair, N., De Wolf, D., Nguyen, P. A., Pham, Q. H., Samara-Kuko, E., Landau, J., et al. (2021). Gene Therapy for Hemophilia B Using CB 2679d-GT: A Novel Factor IX Variant with Higher Potency Than Factor IX Padua. Blood 137 (21), 2902–2906. doi:10.1182/blood.2020006005

PubMed Abstract | CrossRef Full Text | Google Scholar

Nisthal, A., Wang, C. Y., Ary, M. L., and Mayo, S. L. (2019). Protein Stability Engineering Insights Revealed by Domain-Wide Comprehensive Mutagenesis. Proc. Natl. Acad. Sci. U. S. A. 116 (33), 16367–16377. doi:10.1073/pnas.1903888116

PubMed Abstract | CrossRef Full Text | Google Scholar

Pettersen, E. F., Goddard, T. D., Huang, C. C., Couch, G. S., Greenblatt, D. M., Meng, E. C., et al. (2004). UCSF Chimera-Aa Visualization System for Exploratory Research and Analysis. J. Comput. Chem. 25 (13), 1605–1612. doi:10.1002/jcc.20084

PubMed Abstract | CrossRef Full Text | Google Scholar

Rallapalli, P. M., Kemball-Cook, G., Tuddenham, E. G., Gomez, K., and Perkins, S. J. (2013). An Interactive Mutation Database for Human Coagulation Factor IX Provides Novel Insights into the Phenotypes and Genetics of Hemophilia B. J. Thromb. Haemost. 11 (7), 1329–1340. doi:10.1111/jth.12276

PubMed Abstract | CrossRef Full Text | Google Scholar

Rao, Z., Handford, P., Mayhew, M., Knott, V., Brownlee, G. G., and Stuart, D. (1995). The Structure of a Ca(2+)-Binding Epidermal Growth Factor-like Domain: its Role in Protein-Protein Interactions. Cell 82 (1), 131–141. doi:10.1016/0092-8674(95)90059-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Rawala-Sheikh, R., Ahmad, S. S., Monroe, D. M., Roberts, H. R., and Walsh, P. N. (1992). Role of Gamma-Carboxyglutamic Acid Residues in the Binding of Factor IXa to Platelets and in Factor-X Activation. Blood 79 (2), 398–405. doi:10.1182/blood.v79.2.398.398

PubMed Abstract | CrossRef Full Text | Google Scholar

Reichmann, D., Rahat, O., Albeck, S., Meged, R., Dym, O., and Schreiber, G. (2005). The Modular Architecture of Protein-Protein Binding Interfaces. Proc. Natl. Acad. Sci. U. S. A. 102 (1), 57–62. doi:10.1073/pnas.0407280102

PubMed Abstract | CrossRef Full Text | Google Scholar

Santoro, C., Quintavalle, G., Castaman, G., Baldacci, E., Ferretti, A., Riccardi, F., et al. (2018). Inhibitors in Hemophilia B. Semin. Thromb. Hemost. 44 (6), 578–589. doi:10.1055/s-0038-1660817

PubMed Abstract | CrossRef Full Text | Google Scholar

Shannon, P., Markiel, A., Ozier, O., Baliga, N. S., Wang, J. T., Ramage, D., et al. (2003). Cytoscape: A Software Environment for Integrated Models of Biomolecular Interaction Networks. Genome Res. 13 (11), 2498–2504. doi:10.1101/gr.1239303

PubMed Abstract | CrossRef Full Text | Google Scholar

Sim, N. L., Kumar, P., Hu, J., Henikoff, S., Schneider, G., and Ng, P. C. (2012). SIFT Web Server: Predicting Effects of Amino Acid Substitutions on Proteins. Nucleic Acids Res. 40 (Web Server issue), W452–W457. doi:10.1093/nar/gks539

PubMed Abstract | CrossRef Full Text | Google Scholar

Simioni, P., Tormene, D., Tognin, G., Gavasso, S., Bulato, C., Iacobelli, N. P., et al. (2009). X-Linked Thrombophilia with a Mutant Factor IX (Factor IX Padua). N. Engl. J. Med. 361 (17), 1671–1675. doi:10.1056/NEJMoa0904377

PubMed Abstract | CrossRef Full Text | Google Scholar

Tunyasuvunakool, K., Adler, J., Wu, Z., Green, T., Zielinski, M., Žídek, A., et al. (2021). Highly Accurate Protein Structure Prediction for the Human Proteome. Nature 596 (7873), 590–596. doi:10.1038/s41586-021-03828-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Vapnik, V. N. (2000). The Nature of Statistical Learning Theory. New York: Springer.

Google Scholar

Venkateswarlu, D. (2014). Structural Insights into the Interaction of Blood Coagulation Co-Factor VIIIa with Factor IXa: A Computational Protein-Protein Docking and Molecular Dynamics Refinement Study. Biochem. Biophys. Res. Commun. 452 (3), 408–414. doi:10.1016/j.bbrc.2014.08.078

PubMed Abstract | CrossRef Full Text | Google Scholar

Venkateswarlu, D. (2010). Structural Investigation of Zymogenic and Activated Forms of Human Blood Coagulation Factor VIII: A Computational Molecular Dynamics Study. BMC Struct. Biol. 10, 7. doi:10.1186/1472-6807-10-7

PubMed Abstract | CrossRef Full Text | Google Scholar

White, G. C., Rosendaal, F., Aledort, L. M., Lusher, J. M., Rothschild, C., Ingerslev, J., et al. (2001). Definitions in Hemophilia. Recommendation of the Scientific Subcommittee on Factor VIII and Factor IX of the Scientific and Standardization Committee of the International Society on Thrombosis and Haemostasis. Thromb. Haemost. 85 (3), 560.

PubMed Abstract | CrossRef Full Text | Google Scholar

Wilkinson, F. H., Ahmad, S. S., and Walsh, P. N. (2002). The Factor IXa Second Epidermal Growth Factor (EGF2) Domain Mediates Platelet Binding and Assembly of the Factor X Activating Complex. J. Biol. Chem. 277 (8), 5734–5741. doi:10.1074/jbc.M107753200

PubMed Abstract | CrossRef Full Text | Google Scholar

Word, J. M., Lovell, S. C., LaBean, T. H., Taylor, H. C., Zalis, M. E., Presley, B. K., et al. (1999a). Visualizing and Quantifying Molecular Goodness-Of-Fit: Small-Probe Contact Dots with Explicit Hydrogen Atoms. J. Mol. Biol. 285 (4), 1711–1733. doi:10.1006/jmbi.1998.2400

PubMed Abstract | CrossRef Full Text | Google Scholar

Word, J. M., Lovell, S. C., Richardson, J. S., and Richardson, D. C. (1999b). Asparagine and Glutamine: Using Hydrogen Atom Contacts in the Choice of Side-Chain Amide Orientation. J. Mol. Biol. 285 (4), 1735–1747. doi:10.1006/jmbi.1998.2401

PubMed Abstract | CrossRef Full Text | Google Scholar

Yan, W., Zhou, J., Sun, M., Chen, J., Hu, G., and Shen, B. (2014). The Construction of an Amino Acid Network for Understanding Protein Structure and Function. Amino Acids 46 (6), 1419–1439. doi:10.1007/s00726-014-1710-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhong, D., Bajaj, M. S., Schmidt, A. E., and Bajaj, S. P. (2002). The N-Terminal Epidermal Growth Factor-Like Domain in Factor IX and Factor X Represents an Important Recognition Motif for Binding to Tissue Factor. J. Biol. Chem. 277 (5), 3622–3631. doi:10.1074/jbc.M111202200

PubMed Abstract | CrossRef Full Text | Google Scholar

Which of the following is the best prediction of how the new disease will affect the two populations?

Which of the following statements best predicts the effect of increasing the concentration of substrate?

Which of the following best predicts how the structure and function of pepsin will change?

Which of the following outcomes will most likely result from a change in the shape?