博客
关于我
强烈建议你试试无所不能的chatGPT,快点击我
2020-11-30
阅读量:4089 次
发布时间:2019-05-25

本文共 9974 字,大约阅读时间需要 33 分钟。

Erasure Codes in Distributed Storage for Effective Repair Bandwidth:

 

The reliability of erasure-coded distributed storage systems, as measured by the mean time to data loss (MTTDL), depends on the repair bandwidth of the code. Thus, efficient coding schemes that exploit repair bandwidths when a limited number of disks fail is important. We came with the first erasure code designs that achieve points between the two extremes on the repair bandwidth and storage trade-off that are asymptotically optimal. Further, the impact of optimal erasure code designs to mean time to data loss of the system is characterized. The figure alongside shows the state transition for a serial repair system accounting for repair in erasure coded systems.

  • T. Luo, V. Aggarwal, and B. Peleato, "," IEEE Transactions on Information Theory, vol. 65, no. 12, pp. 7742-7755, Dec. 2019.
  • V. Aggarwal, "," arXiv, Nov 2016.
  • C. Tian, B. Sasidharan, V. Aggarwal, V.A. Vaishampayan, P.V. Kumar, "," in IEEE Transactions on Information Theory, vol.61, no.4, pp.1933-1947, April 2015
  • V. Aggarwal, C. Tian, V. Vaishampayan, and R. Chen "," in Proc. IEEE Infocomm 2014.
  • C. Tian, V. Aggarwal, and V. Vaishampayan, "," ArXiv Preprint, 2013
  • C. Tian, V. Aggarwal, and V. Vaishampayan, "," in Proc. IEEE ISIT, Jul. 2013

Straggler Management with Coding and Queueing Strategies:

 

The performance of large-scale distributed compute systems is adversely impacted by stragglers when the execution time of a job is uncertain. In order to manage stragglers, redundancy in the execution is essential. However, to optimize the cost of servers, all servers cannot be started in the beginning while a tiered strategy (also called multi-forking) is needed. The figure alongside shows the tradeoff between the service completion time and the server utilization cost for shifted exponential service time with different forking times and different number of initial servers. We consider such tradeoffs to determine parameters at which system should be operated. However, these parameters can influence the task sizes in the split of tasks over the servers since the straggler guarantees are needed. Multi-forking provides a flexibility that the results of some tasks could be seen before opening new tasks which decreases the execution times. Thus, the problem of efficient management of stragglers requires joint split of tasks (using coding-theoretic schemes) and well as the determination of system parameters using queueing-theoretic techniques that determine the tradeoff between the service completion time and the server utilization cost.

  • A. Badita, P. Parag, and V. Aggarwal, "Sequential addition of coded tasks for straggler mitigation," in Proc. IEEE Infocom, Jul 2020.
  • S. Sasi, V. Lalitha, V. Aggarwal, and B. S. Rajan, "," Accepted to IEEE Transactions on Communications, Apr 2020.
  • A. Badita, P. Parag, and V. Aggarwal, "," IEEE/ACM Transactions on Networking, vol. 28, no. 2, pp. 709-721, April 2020.

 

vaneet_photo

Framework for Interdependent Task Scheduling:

 

Distributed computing applications are becoming increasingly sophisticated and heterogeneous, often involving a collection of highly dependent data-processing tasks and network flows that must work in concert to achieve mission-critical objectives. Traditional techniques that are agnostic to such interdependence do not perform well in optimizing these collections, because resource management is largely framed as an optimization of individual task- or flow-level metrics. In this work, we model different dependence constraints between the different tasks including precedence, fractional precedence, and approximate computing. As an example, the figure alongside shows different forms of constraints for a MapReduce job. With these models of task dependence, we have proposed efficient scheduling strategies, with their performance guarantees.

  • V. Aggarwal and R. Mao, "," Information Processing Letters, Volume 153, January 2020.
  • R. Mao, V. Aggarwal, and T. Lan, "Preemptive Scheduling on Unrelated Machines with Fractional Precedence Constraints," Submitted.
  • V. Aggarwal, M. Xu, T. Lan, and S. Subramaniam, "" Submitted.
  • R. Mao, V. Aggarwal, and M. Chiang, "" Submitted.
  • R. Mao, V. Aggarwal, and M. Chiang, "Stochastic Non-preemptive Co-flow Scheduling with Time-Indexed Relaxation," in Proc. Infocom Workshop (International Workshop on Big Data in Cloud Performance (DCPerf)), Apr 2018.

vaneet_photo

Erasure Codes in Distributed Storage for Effective Latency:

 

Modern distributed storage systems offer large capacity to satisfy the exponentially increasing need of storage space. They often use erasure codes to protect against disk and node failures to increase reliability, while trying to meet the latency requirements of the applications and clients. In order to meet these requirements, the code design, chunk placement and the chunk access (when client requests) need to be optimally found. We propose new solutions for joint latency cost tradeoff, and implement these solutions on Tahoe public grid, and AT&T Cloud Systems. The figure alongside depicts the different key design attributes for a general cloud system that we are working towards for a vision of optimized dynamic storage system.

  • V. Aggarwal and T. Lan, "," in Review for Now Foundations and Trends in Communication and Information Theory.
  • A. O. Alabbasi and V. Aggarwal, "TTL-cache: Minimizing Latency in Erasure-coded Storage through Time To Live Caching," Accepted to IEEE Transactions on Network and Service Management, May 2020.
  • A. O. Alabbasi, V. Aggarwal, and T. Lan, "," IEEE Transactions on Network and Service Management, vol. 16, no. 4, pp. 1609-1623, Dec. 2019.
  • Y. Zhang, A. Ghosh, V. Aggarwal, and T. Lan, "," IEEE Transactions on Network and Service Management, vol. 16, no. 1, pp. 176-191, March 2019.
  • A. Alabbasi and V. Aggarwal, "Mean Latency Optimization in Erasure-coded Distributed Storage Systems," in Proc. Infocom Workshop (International Workshop on Cloud Computing Systems, Networks, and Applications (CCSNA)), Apr 2018.
  • V. Aggarwal, J. Fan, and T. Lan, "Taming Tail Latency for Erasure-coded, Distributed Storage Systems," in Proc. IEEE Infocom, Jul. 2017.
  • V. Aggarwal, Y.R. Chen, T. Lan, and Y. Xiang, "," IEEE/ACM Transactions on Networking, vol. 25, no. 6, pp. 3683-3694, Dec 2017.
  • Y. Xiang, V. Aggarwal, T. Lan, and Y.R. Chen, "," Accepted to IEEE Transactions on Cloud Computing, Dec 2016.
  • Y. Xiang, T. Lan, V. Aggarwal, and Y.R. Chen, "," IEEE Transactions on Network and Service Management, vol. 14, no. 1, pp. 204-216, March 2017.
  • V. Aggarwal, Y.R. Chen, T. Lan, and Y. Xiang, "," in Proc. ICDCS, Jun. 2016.
  • Y. Xiang, T. Lan, V. Aggarwal, and Y.R. Chen, "," in Proc. ICDCS, Jun-Jul. 2015.
  • Y. Xiang, V. Aggarwal, Y.R. Chen, and T. Lan, "," in Proc. IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, May 2015.
  • Y. Xiang, T. Lan, V. Aggarwal, and R. Chen, "," IEEE/ACM Transactions on Networking, vol. 24, no. 4, pp. 2443-2457, Aug. 2016.
  • Y. Xiang, T. Lan, V. Aggarwal, and R. Chen, "," ACM SIGMETRICS Performance Evaluation Review, Volume 42 Issue 2, Sep. 2014. (presented in Proc. IFIP, Oct. 2014)

Delivering Deadline based services through Virtualization:

 

Virtualized cloud-based services can take advantage of statistical multiplexing across applications to yield significant cost savings. However, achieving similar savings with real-time services can be a challenge. In these works, we seek to lower a providers costs for real-time IPTV services through a virtualized IPTV architecture and through intelligent time-shifting of selected services. We provide a generalized framework for computing the amount of resources needed to support multiple services, without missing the deadline for any service. We construct the problem as an optimization formulation that uses a generic cost function. We consider multiple forms for the cost function (e.g., maximum, convex and concave functions) reflecting the cost of providing the service. The solution to this formulation gives the number of servers needed at different time instants to support these services. Our results show about 31% improvement in costs for the deployed IPTV services. Further, Video on Demand (VoD) traffic can be delivered using multicast. I showed how IP multicast can be used to reduce load on the VoD server. This involved modeling the on-demand service and designing an optimal algorithm that minimizes server transmissions. Trace data from a deployed AT&T VoD service suggests that our approach reduces server bandwidth by as much as 65% compared to the standard architecture. The graphic is AT&T trace data showing the distribution of customers receiving different short video segments in a 10 minute interval.

vaneet_photo

  • F. Stefanello, V. Aggarwal, L.S. Buriol, and M.G.C. Resende, "," Submitted to Computers and Operations Research, Mar 2018.
  • F. Stefanello, L.S. Buriol, V. Aggarwal, and M.G.C. Resende, "," in Proc. Anais do XLV Simposio Brasileiro de Pesquisa Operacional, Aug. 2015.
  • F. Stefanello, V. Aggarwal, L.S. Buriol, J.F. Goncalves, and M.G.C. Resende, "," in Proc. Genetic and Evolutionary Computation Conference (GECCO), pp. 919-926, Jul. 2015.
  • V. Aggarwal, V. Gopalakrishnan, R. Jana, K. K. Ramakrishnan and V. Vaishampayan, "," R-letters, vol. 4, no. 4, pp. 13-14, Aug. 2013.
  • V. Aggarwal, V. Gopalakrishnan, R. Jana, K. K. Ramakrishnan and V. Vaishampayan, "," IEEE Transactions on Multimedia, special issue on Cloud-Based Mobile Media: Infrastructure, Services, June 2013.
  • W. Pang, P. Zhang, T. Lan, and V. Aggarwal, "" in Proc. IEEE Conference on Information Sciences and Systems (CISS), Mar 2012.
  • V. Aggarwal, V. Gopalakrishnan, R. Jana, K. K. Ramakrishnan and V. Vaishampayan, "," in Proc. IEEE International Conference on Communication Systems and Networks (COMSNETS), Jan 2012.
  • V. Aggarwal, X. Chen, V. Gopalakrishnan, R. Jana, K. K. Ramakrishnan and V. Vaishampayan, "," in Proc. IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Apr 2011.

 

转载地址:http://yzuii.baihongyu.com/

你可能感兴趣的文章
什么是URL地址?
查看>>
C++多态的实现方式总结
查看>>
学习C++需要注意的问题
查看>>
C++模板
查看>>
C++双冒号(::)的用法
查看>>
【Unity】封装SQLite管理类
查看>>
【Unity】面试题整理
查看>>
【C#】如何实现一个迭代器
查看>>
【Unity】Destroy和DestroyImmediate的区别
查看>>
【Lua】Mac系统下配置SublimeText的Lua编译环境
查看>>
【C#】利用Conditional属性完成编译忽略
查看>>
【Unity】微信登录后将头像存为bytes,将bytes读取成sprite图片
查看>>
【Unity】使用GPS定位经纬度
查看>>
【UGUI/NGUI】一键换Text/Label字体
查看>>
【C#】身份证本地验证
查看>>
【Unity】坑爹的Bug
查看>>
【算法】求数组中某两个数的和为目标值
查看>>
如何高效学习动态规划?
查看>>
动态规划法(六)鸡蛋掉落问题(一)
查看>>
LeetCode 887.鸡蛋掉落(C++)
查看>>